Sep 29 11:47:54 devstack cinder-volume[75137]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 11:47:54 devstack cinder-volume[75137]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 11:47:54 devstack cinder-volume[75137]: we strongly recommend against using it for new projects. Sep 29 11:47:54 devstack cinder-volume[75137]: If you are already using Eventlet, we recommend migrating to a different Sep 29 11:47:54 devstack cinder-volume[75137]: framework. For more detail see Sep 29 11:47:54 devstack cinder-volume[75137]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 11:47:54 devstack cinder-volume[75137]: import eventlet # noqa Sep 29 11:47:57 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 11:47:57 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 11:47:57 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 11:47:58 devstack cinder-volume[75137]: INFO dbcounter [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Registered counter for database cinder Sep 29 11:47:58 devstack cinder-volume[75137]: DEBUG oslo_db.sqlalchemy.engines [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:47:59 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writer thread running {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 11:47:59 devstack cinder-volume[75137]: INFO cinder.rpc [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 11:47:59 devstack cinder-volume[75137]: INFO cinder.rpc [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 11:47:59 devstack cinder-volume[75137]: DEBUG oslo_db.sqlalchemy.engines [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:47:59 devstack cinder-volume[75137]: INFO cinder.volume.manager [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Determined volume DB was empty at startup. Sep 29 11:47:59 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75137) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 11:47:59 devstack cinder-volume[75137]: INFO cinder.volume.manager [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 11:47:59 devstack cinder-volume[75137]: WARNING stevedore.named [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 11:47:59 devstack cinder-volume[75137]: WARNING castellan.key_manager [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 11:47:59 devstack cinder-volume[75137]: WARNING cinder.keymgr.conf_key_mgr [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 11:47:59 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75137) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 29 11:47:59 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:47:59 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_db.sqlalchemy.engines [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:48:00 devstack cinder-volume[75137]: INFO cinder.rpc [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 29 11:48:00 devstack cinder-volume[75137]: INFO cinder.rpc [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 29 11:48:00 devstack cinder-volume[75137]: WARNING stevedore.named [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 11:48:00 devstack cinder-volume[75137]: WARNING castellan.key_manager [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 11:48:00 devstack cinder-volume[75137]: INFO cinder.volume.manager [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_db.sqlalchemy.engines [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:48:00 devstack cinder-volume[75137]: INFO oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Starting 1 workers Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Started child 75345 {{(pid=75137) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Full set of CONF: {{(pid=75137) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] ******************************************************************************** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Configuration options gathered from: {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] ================================================================================ {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] allow_availability_zone_fallback = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] allow_compression_on_image_upload = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] allowed_direct_url_schemes = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] api_rate_limit = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] auth_strategy = keystone {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] az_cache_duration = 3600 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75345]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_availability_zone = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_host = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_stats_polling_interval = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backup_api_class = cinder.backup.api.API {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backup_name_template = backup-%s {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backup_use_same_host = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backup_use_temp_snapshot = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] chap_password = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] chap_username = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_internal_tenant_project_id = 3a45329446f04308836feb9df78b6eb1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_internal_tenant_user_id = a969c3d29c904be6b0d6c343b72eeb2d {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cloned_volume_same_az = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cluster = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] compression_format = gzip {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] compute_api_class = cinder.compute.nova.API {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] config_dir = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] config_source = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] control_exchange = openstack {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] debug = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] default_availability_zone = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] default_group_type = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] default_volume_type = lvmdriver-1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] disk_geometry = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] driver_client_cert = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] driver_client_cert_key = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] driver_data_namespace = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] driver_ssl_cert_path = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] driver_ssl_cert_verify = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] driver_use_ssl = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] enable_force_upload = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] enable_new_services = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] enable_unsupported_driver = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] enforce_multipath_for_image_xfer = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] filter_function = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_api_insecure = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_api_ssl_compression = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_ca_certificates_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_catalog_info = image:glance:publicURL {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_num_retries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance_request_timeout = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] goodness_function = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] graceful_shutdown_timeout = 5 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] group_api_class = cinder.group.api.API {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] host = devstack {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_compress_on_upload = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_conversion_address_space_limit = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_conversion_cpu_limit = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_conversion_disable = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_introspection_address_space_limit = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_introspection_cpu_limit = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_upload_use_cinder_backend = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_upload_use_internal_tenant = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_volume_cache_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_volume_cache_max_count = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] image_volume_cache_max_size_gb = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] init_host_max_objects_retrieval = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] instance_format = [instance: %(uuid)s] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] iscsi_target_flags = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] iscsi_write_cache = on {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] iser_helper = tgtadm {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] iser_ip_address = 192.168.122.102 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] iser_port = 3260 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_color = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_config_append = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_dir = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_options = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_rotate_interval = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_rotate_interval_type = days {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] log_rotation_type = none {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] max_age = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] max_logfile_count = 30 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] max_logfile_size_mb = 200 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] max_over_subscription_ratio = 20.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] message_reap_interval = 86400 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] message_ttl = 2592000 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] migration_create_volume_timeout_secs = 300 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] monkey_patch = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] monkey_patch_modules = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] my_ip = 192.168.122.102 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] no_snapshot_gb_quota = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] num_iser_scan_tries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] num_shell_tries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] num_volume_device_scan_tries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] nvmeof_conn_info_version = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] nvmet_ns_id = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] nvmet_port_id = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] osapi_max_limit = 1000 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] osapi_volume_ext_list = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] osapi_volume_listen_port = 8776 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] osapi_volume_use_ssl = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] osapi_volume_workers = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] per_volume_size_limit = -1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] periodic_fuzzy_delay = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] periodic_interval = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] public_endpoint = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] publish_errors = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] quota_backup_gigabytes = 1000 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] quota_backups = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] quota_gigabytes = 1000 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] quota_groups = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] quota_snapshots = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] quota_volumes = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] rate_limit_burst = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] rate_limit_except_level = CRITICAL {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] rate_limit_interval = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] reinit_driver_count = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] replication_device = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] report_discard_supported = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] report_interval = 120 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] reservation_clean_interval = 86400 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] reservation_expire = 86400 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] reserved_image_namespaces = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] reserved_percentage = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] rpc_response_timeout = 120 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] run_external_periodic_tasks = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] scst_target_driver = iscsi {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] scst_target_iqn_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_down_time = 720 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] shell_completion = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] snapshot_name_template = snapshot-%s {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] snapshot_same_host = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] split_loggers = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] state_path = /opt/stack/data/cinder {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] storage_availability_zone = nova {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] storage_protocol = iSCSI {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] syslog_log_facility = LOG_USER {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] target_helper = lioadm {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] target_ip_address = 192.168.122.102 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] target_port = 3260 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] target_protocol = iscsi {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] target_secondary_ip_addresses = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] trace_flags = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] transport_url = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] until_refresh = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] use_chap_auth = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] use_default_quota_class = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] use_journal = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] use_json = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] use_multipath_for_image_xfer = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] use_stderr = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] use_syslog = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] verify_glance_signatures = enabled {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_api_class = cinder.volume.api.API {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_backend_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_clear = zero {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_clear_ionice = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_clear_size = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_copy_bps_limit = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_dd_blocksize = 1M {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_name_template = volume-%s {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_service_inithost_offload = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volume_usage_audit_period = month {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] zoning_mode = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_concurrency.disable_process_locking = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.auth_section = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.auth_type = password {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.auth_version = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.cache = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.include_service_catalog = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.insecure = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.interface = public {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_password = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcache_username = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.region_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.service_token_roles_required = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.service_type = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.backend = dogpile.cache.null {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.backend_argument = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.backend_expiration_time = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.config_prefix = cache.oslo {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.debug_cache_backend = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.enable_retry_client = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.enable_socket_keepalive = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.expiration_time = 600 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.hashclient_retry_attempts = 2 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.memcache_dead_retry = 300 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.memcache_pool_maxsize = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.memcache_sasl_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack sudo[75349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.password = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.proxies = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack sudo[75349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.redis_db = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.redis_server = localhost:6379 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.retry_attempts = 2 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.retry_delay = 0.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.socket_keepalive_count = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.socket_keepalive_idle = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.socket_keepalive_interval = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.socket_timeout = 1.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.tls_allowed_ciphers = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.tls_cafile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.tls_certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.tls_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.tls_keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cache.username = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] coordination.backend_url = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.asyncio_connection = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.asyncio_slave_connection = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.backend = sqlalchemy {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.connection = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.connection_debug = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.connection_parameters = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.connection_recycle_time = 3600 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.connection_trace = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.db_inc_retry_interval = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.db_max_retries = 20 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.db_max_retry_interval = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.db_retry_interval = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.max_overflow = 50 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.max_pool_size = 5 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.max_retries = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.mysql_wsrep_sync_wait = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.pool_timeout = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.retry_interval = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.slave_connection = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.sqlite_synchronous = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.synchronous_reader = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] database.use_db_reconnect = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_tracing.insecure = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.connection_string = messaging:// {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.es_doc_type = notification {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.es_scroll_size = 10000 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.es_scroll_time = 2m {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.filter_error_trace = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.hmac_keys = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.sentinel_service_name = mymaster {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.socket_timeout = 0.1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.trace_requests = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler.trace_sqlalchemy = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler_jaeger.process_tags = {} {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler_jaeger.service_name_prefix = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] profiler_otlp.service_name_prefix = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.enforce_new_defaults = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.policy_default_rule = default {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.policy_file = policy.yaml {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] privsep_osbrick.group = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] privsep_osbrick.helper_command = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] privsep_osbrick.user = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_sys_admin.group = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_sys_admin.helper_command = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] cinder_sys_admin.user = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.auth_section = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.auth_type = password {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.cafile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.collect_timing = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.insecure = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.send_service_user_token = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.split_loggers = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.timeout = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.tls_ciphers = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] service_user.tls_min_version = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.auth_section = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.auth_type = password {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.collect_timing = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.insecure = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.region_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.split_loggers = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.timeout = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.tls_ciphers = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] glance.tls_min_version = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.backend_availability_zone = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.chap_password = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.chap_username = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.disk_geometry = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.driver_client_cert = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.driver_client_cert_key = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.driver_data_namespace = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.driver_use_ssl = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.extra_capabilities = {} {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.filter_function = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.goodness_function = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.iscsi_target_flags = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.iscsi_write_cache = on {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.iser_helper = tgtadm {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.iser_port = 3260 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.lvm_share_target = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.lvm_type = auto {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.num_shell_tries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.replication_device = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.report_discard_supported = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.reserved_percentage = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.target_helper = tgtadm {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.target_port = 3260 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.target_protocol = iscsi {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.trace_flags = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.unique_fqdn_network = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.use_chap_auth = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_backend_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_clear = zero {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_clear_ionice = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_clear_size = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_reports.file_event_handler = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_reports.log_dir = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.backend_host = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.chap_password = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.chap_username = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.disk_geometry = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.driver_client_cert = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.extra_capabilities = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.filter_function = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.goodness_function = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.iser_helper = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.iser_ip_address = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.iser_port = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.lvm_share_target = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.lvm_type = auto {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.num_shell_tries = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.replication_device = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.report_discard_supported = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.reserved_percentage = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.scst_target_driver = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.storage_protocol = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.target_helper = lioadm {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.target_ip_address = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.target_port = 3260 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.trace_flags = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.use_chap_auth = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_clear = zero {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_clear_size = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] lvmdriver-1.volumes_dir = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.ssl = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_notifications.driver = [] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_notifications.retry = -1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] key_manager.fixed_key = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.barbican_api_version = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.barbican_endpoint = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.barbican_endpoint_type = public {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.barbican_region_name = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.cafile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.collect_timing = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.insecure = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.number_of_retries = 60 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.retry_delay = 1 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.send_service_user_token = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.split_loggers = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.timeout = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.tls_ciphers = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.tls_min_version = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.verify_ssl = True {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican.verify_ssl_path = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.auth_section = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.auth_type = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.cafile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.certfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.collect_timing = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.insecure = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.keyfile = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.split_loggers = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.timeout = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.tls_ciphers = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] barbican_service_user.tls_min_version = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.approle_role_id = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.approle_secret_id = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.auth_method = approle {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.auth_path = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.kv_mountpoint = secret {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.kv_path = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.kv_version = 2 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.namespace = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.root_token_id = **** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.ssl_ca_crt_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.timeout = 60.0 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.token_file = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.token_role = None {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.use_ssl = False {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:48:00 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] ******************************************************************************** {{(pid=75137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 11:48:00 devstack sudo[75349]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:01 devstack sudo[75420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:01 devstack sudo[75420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:01 devstack sudo[75420]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.357s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 11:48:01 devstack cinder-volume[75345]: INFO cinder.brick.local_dev.lvm [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:01 devstack sudo[75543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:48:01 devstack sudo[75543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:01 devstack sudo[75543]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG cinder.brick.local_dev.lvm [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75345) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 29 11:48:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:01 devstack sudo[75628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:01 devstack sudo[75628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:02 devstack sudo[75628]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.528s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:02 devstack sudo[75816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:02 devstack sudo[75816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:02 devstack sudo[75816]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:02 devstack sudo[75935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 29 11:48:02 devstack sudo[75935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:02 devstack sudo[75935]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.334s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:02 devstack sudo[75964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:48:02 devstack sudo[75964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:03 devstack sudo[75964]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:03 devstack sudo[76048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:48:03 devstack sudo[76048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:03 devstack sudo[76048]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:03 devstack sudo[76051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:48:03 devstack sudo[76051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:03 devstack sudo[76051]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:03 devstack sudo[76097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:03 devstack sudo[76097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:04 devstack sudo[76097]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:04 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:04 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:04 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:04 devstack cinder-volume[75345]: INFO cinder.volume.drivers.lvm [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:04 devstack sudo[76148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:04 devstack sudo[76148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:04 devstack sudo[76148]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:04 devstack sudo[76151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:48:04 devstack sudo[76151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:04 devstack sudo[76151]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:04 devstack sudo[76160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:48:04 devstack sudo[76160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:05 devstack sudo[76160]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:05 devstack sudo[76163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:05 devstack sudo[76163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:05 devstack sudo[76163]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:05 devstack sudo[76166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:48:05 devstack sudo[76166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:05 devstack sudo[76166]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:05 devstack cinder-volume[75345]: INFO cinder.volume.driver [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG cinder.volume.driver [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75345) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG oslo_db.sqlalchemy.engines [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writer thread running {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG cinder.db.api [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Building query based on filter {{(pid=75345) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG cinder.image.image_utils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75345) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 11:48:05 devstack cinder-volume[75345]: INFO cinder.keymgr.migration [None req-9d77bf57-9c74-48d5-b668-84357e39bec9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 11:48:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:05 devstack sudo[76169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:48:05 devstack sudo[76169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:06 devstack sudo[76169]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:06 devstack sudo[76174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:48:06 devstack sudo[76174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:06 devstack sudo[76174]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:06 devstack sudo[76178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:06 devstack sudo[76178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:06 devstack sudo[76178]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:06 devstack sudo[76181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:48:06 devstack sudo[76181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:07 devstack sudo[76181]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:48:07 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Driver initialization completed successfully. Sep 29 11:48:07 devstack cinder-volume[75345]: INFO cinder.manager [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Initiating service 2 cleanup Sep 29 11:48:07 devstack cinder-volume[75345]: INFO cinder.manager [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Service 2 cleanup completed. Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG cinder.service [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Creating RPC server for service cinder-volume {{(pid=75345) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG cinder.service [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75345) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 11:48:07 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:07 devstack sudo[76184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:48:07 devstack sudo[76184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:07 devstack sudo[76184]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:07 devstack sudo[76189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:48:07 devstack sudo[76189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:07 devstack sudo[76189]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:07 devstack sudo[76192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:48:07 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:08 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:08 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:08 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:48:08 devstack sudo[76195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:48:08 devstack sudo[76195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:48:08 devstack sudo[76195]: pam_unix(sudo:session): session closed for user root Sep 29 11:48:08 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:48:08 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7f7183c2-2e69-4b61-b0a4-07c836104e28 None None] Driver post RPC initialization completed successfully. Sep 29 11:48:10 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:48:17 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=2 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:48:18 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:48:20 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager._thread_info {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:48:20 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread count: 6 {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:48:20 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread info: [<_MainThread(MainThread, started 126314436694144)>, , , , , ] {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:49:20 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:49:20 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 11:49:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:49:20 devstack sudo[78686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:49:20 devstack sudo[78686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:49:20 devstack sudo[78686]: pam_unix(sudo:session): session closed for user root Sep 29 11:49:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:49:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:49:20 devstack sudo[78689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:49:20 devstack sudo[78689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:49:20 devstack sudo[78689]: pam_unix(sudo:session): session closed for user root Sep 29 11:49:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:49:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:49:20 devstack sudo[78692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:49:20 devstack sudo[78692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:49:21 devstack sudo[78692]: pam_unix(sudo:session): session closed for user root Sep 29 11:49:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:49:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:49:21 devstack sudo[78695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:49:21 devstack sudo[78695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:49:21 devstack sudo[78695]: pam_unix(sudo:session): session closed for user root Sep 29 11:49:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:49:21 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:49:21 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager._thread_info {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:49:21 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread count: 6 {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:49:21 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread info: [<_MainThread(MainThread, started 126314436694144)>, , , , , ] {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:50:18 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:50:18 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:UPDATE=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:50:20 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:50:20 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 11:50:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:50:20 devstack sudo[81703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:50:20 devstack sudo[81703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:50:20 devstack sudo[81703]: pam_unix(sudo:session): session closed for user root Sep 29 11:50:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:50:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:50:20 devstack sudo[81706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:50:20 devstack sudo[81706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:50:20 devstack sudo[81706]: pam_unix(sudo:session): session closed for user root Sep 29 11:50:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:50:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:50:20 devstack sudo[81714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:50:20 devstack sudo[81714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:50:21 devstack sudo[81714]: pam_unix(sudo:session): session closed for user root Sep 29 11:50:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:50:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:50:21 devstack sudo[81717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:50:21 devstack sudo[81717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:50:21 devstack sudo[81717]: pam_unix(sudo:session): session closed for user root Sep 29 11:50:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:50:21 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:50:21 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager._thread_info {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:50:21 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread count: 6 {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:50:21 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread info: [<_MainThread(MainThread, started 126314436694144)>, , , , , ] {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:51:20 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:51:20 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 11:51:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:51:20 devstack sudo[83831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:51:20 devstack sudo[83831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:51:20 devstack sudo[83831]: pam_unix(sudo:session): session closed for user root Sep 29 11:51:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:51:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:51:20 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:51:20 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:51:20 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Sep 29 11:51:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:51:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:51:20 devstack sudo[83862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:51:20 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:51:21 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root Sep 29 11:51:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:51:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:51:21 devstack sudo[83867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:51:21 devstack sudo[83867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:51:21 devstack sudo[83867]: pam_unix(sudo:session): session closed for user root Sep 29 11:51:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:51:21 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:52:18 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:52:20 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:52:20 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 11:52:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:20 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 11:52:20 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:20 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:20 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:52:20 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:20 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:20 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:20 devstack sudo[84947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 11:52:20 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:21 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:21 devstack sudo[84964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 11:52:21 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:21 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:21 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:21 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:52:21 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] Running periodic task VolumeManager._thread_info {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:52:21 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread count: 6 {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:52:21 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-dfdde25d-afb4-4771-9f16-8937c1b3007f None None] thread info: [<_MainThread(MainThread, started 126314436694144)>, , , , , ] {{(pid=75345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:52:29 devstack cinder-volume[75137]: INFO oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Caught SIGTERM, stopping children Sep 29 11:52:29 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Acquiring lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 11:52:29 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Acquired lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 11:52:29 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Releasing lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 11:52:29 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Stop services. {{(pid=75137) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 11:52:29 devstack cinder-volume[75137]: DEBUG oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Killing children. {{(pid=75137) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 11:52:29 devstack cinder-volume[75137]: INFO oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Waiting on 1 children to exit Sep 29 11:52:32 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Acquiring lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 11:52:32 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Acquired lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 11:52:32 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Releasing lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 11:52:32 devstack cinder-volume[75345]: WARNING amqp [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 11:52:32 devstack cinder-volume[75345]: WARNING amqp [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 11:52:32 devstack cinder-volume[75137]: INFO oslo_service.backend._eventlet.service [None req-e3e36708-61cb-4ac8-b5af-26e584afa31a None None] Child 75345 exited with status 0 Sep 29 11:52:32 devstack cinder-volume[85289]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 11:52:32 devstack cinder-volume[85289]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 11:52:32 devstack cinder-volume[85289]: we strongly recommend against using it for new projects. Sep 29 11:52:32 devstack cinder-volume[85289]: If you are already using Eventlet, we recommend migrating to a different Sep 29 11:52:32 devstack cinder-volume[85289]: framework. For more detail see Sep 29 11:52:32 devstack cinder-volume[85289]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 11:52:32 devstack cinder-volume[85289]: import eventlet # noqa Sep 29 11:52:34 devstack cinder-volume[85289]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 11:52:34 devstack cinder-volume[85289]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 11:52:34 devstack cinder-volume[85289]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 11:52:35 devstack cinder-volume[85289]: INFO dbcounter [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Registered counter for database cinder Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_db.sqlalchemy.engines [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG dbcounter [-] [85289] Writer thread running {{(pid=85289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 11:52:35 devstack cinder-volume[85289]: INFO cinder.rpc [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 11:52:35 devstack cinder-volume[85289]: INFO cinder.rpc [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_db.sqlalchemy.engines [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:35 devstack cinder-volume[85289]: INFO cinder.volume.manager [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Determined volume DB was empty at startup. Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG cinder.volume.manager [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85289) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 11:52:35 devstack cinder-volume[85289]: INFO cinder.volume.manager [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 11:52:35 devstack cinder-volume[85289]: WARNING stevedore.named [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 11:52:35 devstack cinder-volume[85289]: WARNING castellan.key_manager [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 11:52:35 devstack cinder-volume[85289]: WARNING cinder.keymgr.conf_key_mgr [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 11:52:35 devstack cinder-volume[85289]: INFO cinder.volume.manager [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_db.sqlalchemy.engines [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:35 devstack cinder-volume[85289]: INFO oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Starting 1 workers Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Started child 85506 {{(pid=85289) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Full set of CONF: {{(pid=85289) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] ******************************************************************************** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Configuration options gathered from: {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] ================================================================================ {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] allow_availability_zone_fallback = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] allow_compression_on_image_upload = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] allowed_direct_url_schemes = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] api_rate_limit = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] auth_strategy = keystone {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_availability_zone = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_host = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_stats_polling_interval = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backup_api_class = cinder.backup.api.API {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:35 devstack cinder-volume[85506]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backup_name_template = backup-%s {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backup_use_same_host = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backup_use_temp_snapshot = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] chap_password = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] chap_username = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_internal_tenant_project_id = 3a45329446f04308836feb9df78b6eb1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_internal_tenant_user_id = a969c3d29c904be6b0d6c343b72eeb2d {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cluster = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] compression_format = gzip {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] compute_api_class = cinder.compute.nova.API {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] config_dir = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] config_source = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] control_exchange = openstack {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] debug = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] default_availability_zone = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] default_group_type = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] default_volume_type = QuobyteHD {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] disk_geometry = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] driver_client_cert = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] driver_client_cert_key = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] driver_data_namespace = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] driver_ssl_cert_path = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] driver_ssl_cert_verify = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] driver_use_ssl = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] enable_new_services = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] enable_unsupported_driver = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] enabled_backends = ['QuobyteHD'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] enforce_multipath_for_image_xfer = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] filter_function = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_api_insecure = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_api_ssl_compression = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_ca_certificates_file = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_catalog_info = image:glance:publicURL {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_num_retries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance_request_timeout = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] goodness_function = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] graceful_shutdown_timeout = 5 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] group_api_class = cinder.group.api.API {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] host = devstack {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_compress_on_upload = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_conversion_address_space_limit = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_conversion_cpu_limit = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_conversion_disable = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_introspection_address_space_limit = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_introspection_cpu_limit = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_upload_use_cinder_backend = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_upload_use_internal_tenant = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_volume_cache_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_volume_cache_max_count = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] image_volume_cache_max_size_gb = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] init_host_max_objects_retrieval = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] instance_format = [instance: %(uuid)s] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] iscsi_target_flags = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] iscsi_write_cache = on {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] iser_helper = tgtadm {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] iser_ip_address = 192.168.122.102 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] iser_port = 3260 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_color = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_config_append = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_dir = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_file = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_options = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_rotate_interval = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_rotate_interval_type = days {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] log_rotation_type = none {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] max_age = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] max_logfile_count = 30 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] max_logfile_size_mb = 200 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] max_over_subscription_ratio = 20.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] message_reap_interval = 86400 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] message_ttl = 2592000 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] migration_create_volume_timeout_secs = 300 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] monkey_patch = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] monkey_patch_modules = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] my_ip = 192.168.122.102 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] no_snapshot_gb_quota = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] num_iser_scan_tries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] num_shell_tries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] num_volume_device_scan_tries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] nvmeof_conn_info_version = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] nvmet_ns_id = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] nvmet_port_id = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] osapi_max_limit = 1000 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] osapi_volume_ext_list = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] osapi_volume_listen_port = 8776 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] osapi_volume_use_ssl = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] osapi_volume_workers = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] per_volume_size_limit = -1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] periodic_fuzzy_delay = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] periodic_interval = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] public_endpoint = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] publish_errors = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] quota_backup_gigabytes = 1000 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] quota_backups = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] quota_gigabytes = 1000 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] quota_groups = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] quota_snapshots = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] quota_volumes = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] rate_limit_burst = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] rate_limit_except_level = CRITICAL {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] rate_limit_interval = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] reinit_driver_count = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] replication_device = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] report_discard_supported = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] report_interval = 120 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] reservation_clean_interval = 86400 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] reservation_expire = 86400 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] reserved_image_namespaces = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] reserved_percentage = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] rpc_response_timeout = 120 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] run_external_periodic_tasks = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] scst_target_driver = iscsi {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] scst_target_iqn_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_down_time = 720 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] shell_completion = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] snapshot_name_template = snapshot-%s {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] split_loggers = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] state_path = /opt/stack/data/cinder {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] storage_availability_zone = nova {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] storage_protocol = iSCSI {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.remotefs [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85506) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] syslog_log_facility = LOG_USER {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] target_helper = lioadm {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] target_ip_address = 192.168.122.102 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] target_port = 3260 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] target_protocol = iscsi {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] target_secondary_ip_addresses = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] trace_flags = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] transport_url = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] until_refresh = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] use_chap_auth = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] use_default_quota_class = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] use_journal = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] use_json = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] use_multipath_for_image_xfer = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] use_stderr = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] use_syslog = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] verify_glance_signatures = enabled {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_api_class = cinder.volume.api.API {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_backend_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_clear = zero {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_clear_ionice = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_clear_size = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_copy_bps_limit = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_dd_blocksize = 1M {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_name_template = volume-%s {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_service_inithost_offload = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volume_usage_audit_period = month {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] zoning_mode = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_concurrency.disable_process_locking = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.auth_section = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.auth_type = password {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.auth_version = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.cache = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.include_service_catalog = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.insecure = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.interface = public {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_password = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcache_username = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.region_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.service_type = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.backend = dogpile.cache.null {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.backend_argument = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.backend_expiration_time = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.config_prefix = cache.oslo {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.debug_cache_backend = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.enable_retry_client = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.enable_socket_keepalive = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.expiration_time = 600 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.hashclient_retry_attempts = 2 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.memcache_dead_retry = 300 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.memcache_pool_maxsize = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.memcache_sasl_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.password = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.proxies = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.redis_db = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.redis_server = localhost:6379 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.retry_attempts = 2 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.retry_delay = 0.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.socket_keepalive_count = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.socket_keepalive_idle = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.socket_keepalive_interval = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.socket_timeout = 1.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.tls_allowed_ciphers = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.tls_cafile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.tls_certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.tls_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.tls_keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cache.username = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] coordination.backend_url = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.asyncio_connection = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.asyncio_slave_connection = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.backend = sqlalchemy {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.connection = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.connection_debug = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.connection_parameters = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.connection_recycle_time = 3600 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.connection_trace = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.db_inc_retry_interval = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.db_max_retries = 20 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.db_max_retry_interval = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.db_retry_interval = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.max_overflow = 50 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.max_pool_size = 5 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.max_retries = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.mysql_wsrep_sync_wait = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.pool_timeout = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.retry_interval = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.slave_connection = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.sqlite_synchronous = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.synchronous_reader = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] database.use_db_reconnect = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_tracing.insecure = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.connection_string = messaging:// {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.es_doc_type = notification {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.es_scroll_size = 10000 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.es_scroll_time = 2m {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.filter_error_trace = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.hmac_keys = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.sentinel_service_name = mymaster {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.socket_timeout = 0.1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.trace_requests = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler.trace_sqlalchemy = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler_jaeger.process_tags = {} {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler_jaeger.service_name_prefix = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] profiler_otlp.service_name_prefix = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.enforce_new_defaults = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.policy_default_rule = default {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.policy_file = policy.yaml {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] privsep_osbrick.group = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] privsep_osbrick.helper_command = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] privsep_osbrick.user = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_sys_admin.group = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_sys_admin.helper_command = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] cinder_sys_admin.user = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.auth_section = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.auth_type = password {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.cafile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.collect_timing = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.insecure = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.send_service_user_token = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.split_loggers = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.timeout = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.tls_ciphers = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] service_user.tls_min_version = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.auth_section = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.auth_type = password {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.collect_timing = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.insecure = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.region_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.split_loggers = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.timeout = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.tls_ciphers = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] glance.tls_min_version = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.backend_availability_zone = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.chap_password = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.chap_username = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.disk_geometry = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.driver_client_cert = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.driver_client_cert_key = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.driver_data_namespace = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.driver_use_ssl = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85506) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 11:52:36 devstack cinder-volume[85506]: WARNING cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 11:52:36 devstack cinder-volume[85506]: WARNING cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.extra_capabilities = {} {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.filter_function = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.goodness_function = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.iscsi_target_flags = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Running cmd (subprocess): mount.quobyte {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.iscsi_write_cache = on {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.iser_helper = tgtadm {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.iser_port = 3260 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_host = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_login = admin {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_mount_options = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_password = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_private_key = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_share_path = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.num_shell_tries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.quobyte_volume_url = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.replication_device = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.report_discard_supported = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.reserved_percentage = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.target_helper = tgtadm {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.target_port = 3260 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.target_protocol = iscsi {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.trace_flags = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.unique_fqdn_network = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.use_chap_auth = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_backend_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_clear = zero {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_clear_ionice = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_clear_size = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_reports.file_event_handler = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_reports.log_dir = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.backend_availability_zone = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.backend_host = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.chap_password = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.chap_username = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.chiscsi_conf = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.disk_geometry = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.driver_client_cert = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.driver_data_namespace = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.driver_use_ssl = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.extra_capabilities = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.filter_function = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.goodness_function = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.iser_helper = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.iser_ip_address = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.iser_port = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.iser_target_prefix = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_host = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_login = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_mount_options = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_password = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_private_key = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_share_path = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_ssh_port = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.num_shell_tries = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.nvmet_port_id = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.replication_device = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.report_discard_supported = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.reserved_percentage = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.scst_target_driver = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.storage_protocol = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.target_helper = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.target_ip_address = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.target_port = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.target_prefix = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.target_protocol = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.trace_flags = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.use_chap_auth = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_clear = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_clear_size = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] QuobyteHD.volumes_dir = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.ssl = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_notifications.driver = [] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_notifications.retry = -1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] key_manager.fixed_key = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.barbican_api_version = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.barbican_endpoint = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.barbican_endpoint_type = public {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.barbican_region_name = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.cafile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.collect_timing = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.insecure = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.number_of_retries = 60 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.retry_delay = 1 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.send_service_user_token = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.split_loggers = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.timeout = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.tls_ciphers = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.tls_min_version = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.verify_ssl = True {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican.verify_ssl_path = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.auth_section = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.auth_type = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.cafile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.certfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.collect_timing = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.insecure = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.keyfile = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.split_loggers = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.timeout = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.tls_ciphers = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] barbican_service_user.tls_min_version = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.approle_role_id = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.approle_secret_id = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.auth_method = approle {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.auth_path = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.kv_mountpoint = secret {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.kv_path = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.kv_version = 2 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.namespace = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.root_token_id = **** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.ssl_ca_crt_file = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.timeout = 60.0 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.token_file = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.token_role = None {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.use_ssl = False {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:36 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] ******************************************************************************** {{(pid=85289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 11:52:36 devstack quobyte-client[85507]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 11:52:36 devstack quobyte-client[85507]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] CMD "mount.quobyte" returned: 1 in 0.176s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:52:36 devstack cinder-volume[85506]: INFO cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d ... Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 -c /etc/quobyte/client-cinder.cfg {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:36 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 -c /etc/quobyte/client-cinder.cfg Sep 29 11:52:36 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:36 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.391s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:36 devstack cinder-volume[85506]: INFO cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d succeeded Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.402s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:36 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:52:36 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:36 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.245s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:36 devstack cinder-volume[85506]: INFO cinder.volume.driver [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 11:52:36 devstack cinder-volume[85506]: DEBUG cinder.volume.driver [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0487976074219, 'free_capacity_gb': 1775.0487976074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85506) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_db.sqlalchemy.engines [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG dbcounter [-] [85506] Writer thread running {{(pid=85506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.db.api [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Building query based on filter {{(pid=85506) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.image.image_utils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85506) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 11:52:37 devstack cinder-volume[85506]: INFO cinder.keymgr.migration [None req-0bfcf755-6e90-42bd-b131-eab067dffa01 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:37 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:52:37 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:37 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.232s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.manager [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Notifying Schedulers of capabilities ... {{(pid=85506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:52:37 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Driver initialization completed successfully. Sep 29 11:52:37 devstack cinder-volume[85506]: INFO cinder.manager [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Initiating service 3 cleanup Sep 29 11:52:37 devstack cinder-volume[85506]: INFO cinder.manager [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Service 3 cleanup completed. Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.service [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Creating RPC server for service cinder-volume {{(pid=85506) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.service [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85506) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 11:52:37 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:37 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:52:37 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:37 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:37 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.283s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:37 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-2c40f372-effa-48fb-84c5-ee1e21591a38 None None] Driver post RPC initialization completed successfully. Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:42 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:52:42 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:42 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.282s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:42 devstack cinder-volume[85506]: DEBUG cinder.manager [None req-ee147e5c-b56f-47b4-ad7e-e091146c9936 None None] Notifying Schedulers of capabilities ... {{(pid=85506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:52:42 devstack cinder-volume[85289]: INFO oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Caught SIGTERM, stopping children Sep 29 11:52:42 devstack cinder-volume[85289]: DEBUG oslo_concurrency.lockutils [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Acquiring lock "singleton_lock" {{(pid=85289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 11:52:42 devstack cinder-volume[85289]: DEBUG oslo_concurrency.lockutils [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Acquired lock "singleton_lock" {{(pid=85289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 11:52:42 devstack cinder-volume[85289]: DEBUG oslo_concurrency.lockutils [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Releasing lock "singleton_lock" {{(pid=85289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 11:52:42 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Stop services. {{(pid=85289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 11:52:42 devstack cinder-volume[85289]: DEBUG oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Killing children. {{(pid=85289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 11:52:42 devstack cinder-volume[85289]: INFO oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Waiting on 1 children to exit Sep 29 11:52:45 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Acquiring lock "singleton_lock" {{(pid=85506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 11:52:45 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Acquired lock "singleton_lock" {{(pid=85506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 11:52:45 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Releasing lock "singleton_lock" {{(pid=85506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 11:52:45 devstack cinder-volume[85506]: WARNING amqp [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 11:52:45 devstack cinder-volume[85506]: WARNING amqp [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 11:52:45 devstack cinder-volume[85289]: INFO oslo_service.backend._eventlet.service [None req-b8363c80-125e-4c99-a13c-4f3a8b261719 None None] Child 85506 exited with status 0 Sep 29 11:52:46 devstack cinder-volume[85824]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 11:52:46 devstack cinder-volume[85824]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 11:52:46 devstack cinder-volume[85824]: we strongly recommend against using it for new projects. Sep 29 11:52:46 devstack cinder-volume[85824]: If you are already using Eventlet, we recommend migrating to a different Sep 29 11:52:46 devstack cinder-volume[85824]: framework. For more detail see Sep 29 11:52:46 devstack cinder-volume[85824]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 11:52:46 devstack cinder-volume[85824]: import eventlet # noqa Sep 29 11:52:49 devstack cinder-volume[85824]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85824) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 11:52:49 devstack cinder-volume[85824]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85824) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 11:52:49 devstack cinder-volume[85824]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85824) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 11:52:50 devstack cinder-volume[85824]: INFO dbcounter [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Registered counter for database cinder Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_db.sqlalchemy.engines [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85824) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG dbcounter [-] [85824] Writer thread running {{(pid=85824) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 11:52:50 devstack cinder-volume[85824]: INFO cinder.rpc [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 11:52:50 devstack cinder-volume[85824]: INFO cinder.rpc [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_db.sqlalchemy.engines [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85824) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:50 devstack cinder-volume[85824]: INFO cinder.volume.manager [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Determined volume DB was empty at startup. Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG cinder.volume.manager [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85824) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 11:52:50 devstack cinder-volume[85824]: WARNING stevedore.named [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 11:52:50 devstack cinder-volume[85824]: WARNING castellan.key_manager [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 11:52:50 devstack cinder-volume[85824]: WARNING cinder.keymgr.conf_key_mgr [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 11:52:50 devstack cinder-volume[85824]: INFO cinder.volume.manager [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_db.sqlalchemy.engines [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85824) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:50 devstack cinder-volume[85824]: INFO oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Starting 1 workers Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Started child 86117 {{(pid=85824) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Full set of CONF: {{(pid=85824) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] ******************************************************************************** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] Configuration options gathered from: {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] ================================================================================ {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] allow_availability_zone_fallback = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] allow_compression_on_image_upload = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] allowed_direct_url_schemes = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] api_rate_limit = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] auth_strategy = keystone {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_availability_zone = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_host = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_stats_polling_interval = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backup_api_class = cinder.backup.api.API {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backup_name_template = backup-%s {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backup_use_same_host = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backup_use_temp_snapshot = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] chap_password = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] chap_username = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[86117]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_internal_tenant_project_id = 3a45329446f04308836feb9df78b6eb1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_internal_tenant_user_id = a969c3d29c904be6b0d6c343b72eeb2d {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cluster = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] compression_format = gzip {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] compute_api_class = cinder.compute.nova.API {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] config_dir = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] config_source = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] control_exchange = openstack {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] debug = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] default_availability_zone = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] default_group_type = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] default_volume_type = QuobyteHD {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] disk_geometry = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] driver_client_cert = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] driver_client_cert_key = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] driver_data_namespace = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] driver_ssl_cert_path = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] driver_ssl_cert_verify = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] driver_use_ssl = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] enable_new_services = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] enable_unsupported_driver = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] enabled_backends = ['QuobyteHD'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] enforce_multipath_for_image_xfer = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] filter_function = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_api_insecure = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_api_ssl_compression = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_ca_certificates_file = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_catalog_info = image:glance:publicURL {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_num_retries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance_request_timeout = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] goodness_function = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] graceful_shutdown_timeout = 5 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] group_api_class = cinder.group.api.API {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] host = devstack {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_compress_on_upload = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_conversion_address_space_limit = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_conversion_cpu_limit = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_conversion_disable = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_introspection_address_space_limit = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_introspection_cpu_limit = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_upload_use_cinder_backend = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_upload_use_internal_tenant = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_volume_cache_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_volume_cache_max_count = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] image_volume_cache_max_size_gb = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] init_host_max_objects_retrieval = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] instance_format = [instance: %(uuid)s] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] iscsi_target_flags = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] iscsi_write_cache = on {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] iser_helper = tgtadm {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] iser_ip_address = 192.168.122.102 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] iser_port = 3260 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_color = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_config_append = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_dir = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_file = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_options = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_rotate_interval = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_rotate_interval_type = days {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] log_rotation_type = none {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] max_age = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] max_logfile_count = 30 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] max_logfile_size_mb = 200 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] max_over_subscription_ratio = 20.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] message_reap_interval = 86400 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] message_ttl = 2592000 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] migration_create_volume_timeout_secs = 300 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] monkey_patch = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] monkey_patch_modules = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] my_ip = 192.168.122.102 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] no_snapshot_gb_quota = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] num_iser_scan_tries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] num_shell_tries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] num_volume_device_scan_tries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] nvmeof_conn_info_version = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] nvmet_ns_id = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] nvmet_port_id = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] osapi_max_limit = 1000 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] osapi_volume_ext_list = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] osapi_volume_listen_port = 8776 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] osapi_volume_use_ssl = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] osapi_volume_workers = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] per_volume_size_limit = -1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] periodic_fuzzy_delay = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] periodic_interval = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] public_endpoint = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] publish_errors = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] quota_backup_gigabytes = 1000 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] quota_backups = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] quota_gigabytes = 1000 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] quota_groups = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] quota_snapshots = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] quota_volumes = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] rate_limit_burst = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] rate_limit_except_level = CRITICAL {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] rate_limit_interval = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] reinit_driver_count = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] replication_device = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] report_discard_supported = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] report_interval = 120 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] reservation_clean_interval = 86400 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] reservation_expire = 86400 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] reserved_image_namespaces = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] reserved_percentage = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] rpc_response_timeout = 120 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] run_external_periodic_tasks = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] scst_target_driver = iscsi {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] scst_target_iqn_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_down_time = 720 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] shell_completion = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] snapshot_name_template = snapshot-%s {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] split_loggers = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] state_path = /opt/stack/data/cinder {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] storage_availability_zone = nova {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] storage_protocol = iSCSI {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] syslog_log_facility = LOG_USER {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] target_helper = lioadm {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] target_ip_address = 192.168.122.102 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] target_port = 3260 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] target_protocol = iscsi {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] target_secondary_ip_addresses = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] trace_flags = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] transport_url = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] until_refresh = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] use_chap_auth = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] use_default_quota_class = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] use_journal = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] use_json = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] use_multipath_for_image_xfer = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] use_stderr = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] use_syslog = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] verify_glance_signatures = enabled {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_api_class = cinder.volume.api.API {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_backend_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_clear = zero {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_clear_ionice = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_clear_size = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_copy_bps_limit = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_dd_blocksize = 1M {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_name_template = volume-%s {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_service_inithost_offload = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volume_usage_audit_period = month {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] zoning_mode = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 11:52:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86117) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_concurrency.disable_process_locking = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.auth_section = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.auth_type = password {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.auth_version = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.cache = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.include_service_catalog = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.insecure = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.interface = public {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_password = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcache_username = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.region_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.service_type = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.backend = dogpile.cache.null {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.backend_argument = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.backend_expiration_time = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.config_prefix = cache.oslo {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.debug_cache_backend = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.enable_retry_client = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.enable_socket_keepalive = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.expiration_time = 600 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.hashclient_retry_attempts = 2 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.memcache_dead_retry = 300 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.memcache_pool_maxsize = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.memcache_sasl_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.password = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.proxies = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.redis_db = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.redis_server = localhost:6379 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.retry_attempts = 2 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.retry_delay = 0.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.socket_keepalive_count = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.socket_keepalive_idle = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.socket_keepalive_interval = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.socket_timeout = 1.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.tls_allowed_ciphers = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.tls_cafile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.tls_certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.tls_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.tls_keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cache.username = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] coordination.backend_url = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.asyncio_connection = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.asyncio_slave_connection = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.backend = sqlalchemy {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.connection = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.connection_debug = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.connection_parameters = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.connection_recycle_time = 3600 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.connection_trace = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.db_inc_retry_interval = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.db_max_retries = 20 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.db_max_retry_interval = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.db_retry_interval = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.max_overflow = 50 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.max_pool_size = 5 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.max_retries = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.mysql_wsrep_sync_wait = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.pool_timeout = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.retry_interval = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.slave_connection = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.sqlite_synchronous = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.synchronous_reader = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] database.use_db_reconnect = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_tracing.insecure = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.connection_string = messaging:// {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.es_doc_type = notification {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.es_scroll_size = 10000 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.es_scroll_time = 2m {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.filter_error_trace = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.hmac_keys = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.sentinel_service_name = mymaster {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.socket_timeout = 0.1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.trace_requests = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler.trace_sqlalchemy = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler_jaeger.process_tags = {} {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler_jaeger.service_name_prefix = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] profiler_otlp.service_name_prefix = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.enforce_new_defaults = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.policy_default_rule = default {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.policy_file = policy.yaml {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] privsep_osbrick.group = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] privsep_osbrick.helper_command = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] privsep_osbrick.user = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_sys_admin.group = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_sys_admin.helper_command = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] cinder_sys_admin.user = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.auth_section = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.auth_type = password {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.cafile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.collect_timing = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.insecure = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.send_service_user_token = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.split_loggers = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.timeout = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.tls_ciphers = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] service_user.tls_min_version = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.auth_section = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.auth_type = password {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.collect_timing = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.insecure = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.region_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.split_loggers = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.timeout = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.tls_ciphers = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] glance.tls_min_version = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.backend_availability_zone = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.chap_password = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.chap_username = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.disk_geometry = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.driver_client_cert = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.driver_client_cert_key = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.driver_data_namespace = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.driver_use_ssl = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.extra_capabilities = {} {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.filter_function = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.goodness_function = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.iscsi_target_flags = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.iscsi_write_cache = on {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.iser_helper = tgtadm {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.iser_port = 3260 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_host = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_login = admin {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_mount_options = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_password = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_private_key = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_share_path = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.num_shell_tries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.quobyte_volume_url = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.replication_device = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.report_discard_supported = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.reserved_percentage = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.target_helper = tgtadm {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.target_port = 3260 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.target_protocol = iscsi {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.trace_flags = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.unique_fqdn_network = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.use_chap_auth = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_backend_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_clear = zero {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_clear_ionice = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_clear_size = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_reports.file_event_handler = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_reports.log_dir = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.backend_availability_zone = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.backend_host = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.chap_password = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.chap_username = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.chiscsi_conf = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.disk_geometry = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.driver_client_cert = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.driver_data_namespace = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.driver_use_ssl = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86117) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 11:52:50 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 11:52:50 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Running cmd (subprocess): mount.quobyte {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.extra_capabilities = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.filter_function = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.goodness_function = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.iser_helper = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.iser_ip_address = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.iser_port = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.iser_target_prefix = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_host = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_login = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_mount_options = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_password = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_private_key = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_share_path = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_ssh_port = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.num_shell_tries = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.nvmet_port_id = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.replication_device = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.report_discard_supported = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.reserved_percentage = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.scst_target_driver = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.storage_protocol = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.target_helper = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.target_ip_address = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.target_port = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.target_prefix = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.target_protocol = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.trace_flags = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.use_chap_auth = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_clear = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_clear_size = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] QuobyteHD.volumes_dir = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.ssl = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_notifications.driver = [] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_notifications.retry = -1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] key_manager.fixed_key = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.barbican_api_version = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.barbican_endpoint = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.barbican_endpoint_type = public {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.barbican_region_name = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.cafile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.collect_timing = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.insecure = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.number_of_retries = 60 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.retry_delay = 1 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.send_service_user_token = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.split_loggers = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.timeout = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.tls_ciphers = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.tls_min_version = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.verify_ssl = True {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican.verify_ssl_path = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.auth_section = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.auth_type = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.cafile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:50 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.certfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.collect_timing = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.insecure = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.keyfile = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.split_loggers = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.timeout = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.tls_ciphers = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] barbican_service_user.tls_min_version = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.approle_role_id = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.approle_secret_id = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.auth_method = approle {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.auth_path = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.kv_mountpoint = secret {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.kv_path = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.kv_version = 2 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.namespace = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.root_token_id = **** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.ssl_ca_crt_file = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.timeout = 60.0 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.token_file = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.token_role = None {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.use_ssl = False {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 11:52:51 devstack cinder-volume[85824]: DEBUG oslo_service.backend._eventlet.service [None req-34ed5650-90a5-456c-a692-0497c2c7e3e8 None None] ******************************************************************************** {{(pid=85824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 11:52:51 devstack quobyte-client[86118]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 11:52:51 devstack quobyte-client[86118]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:51 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:52:51 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:51 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.233s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:51 devstack cinder-volume[86117]: INFO cinder.volume.driver [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Driver hasn't implemented _init_vendor_properties() Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.volume.driver [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0487976074219, 'free_capacity_gb': 1775.0487976074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86117) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_db.sqlalchemy.engines [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86117) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writer thread running {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.db.api [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Building query based on filter {{(pid=86117) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86117) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:51 devstack cinder-volume[86117]: INFO cinder.keymgr.migration [None req-152fd2a1-938f-47fc-acc4-0ac4fa4b160e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 11:52:51 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:52:51 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:51 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.227s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:52:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Driver initialization completed successfully. Sep 29 11:52:51 devstack cinder-volume[86117]: INFO cinder.manager [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Initiating service 3 cleanup Sep 29 11:52:51 devstack cinder-volume[86117]: INFO cinder.manager [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Service 3 cleanup completed. Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.service [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Creating RPC server for service cinder-volume {{(pid=86117) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.service [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86117) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 11:52:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:52:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:52:51 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:52:51 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:52:52 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Sep 29 11:52:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.243s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:52:52 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8cb461f7-8145-4d24-bd3d-94d872aa542c None None] Driver post RPC initialization completed successfully. Sep 29 11:53:00 devstack cinder-volume[85824]: DEBUG dbcounter [-] [85824] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85824) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:53:01 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:53:02 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=3 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:53:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:53:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 6 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:53:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Flow 'volume_create_manager' (fd4adf8d-1aeb-4ce6-ae66-ce757764640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8253cd9d-bcd7-4968-9952-27d27e5575a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8253cd9d-bcd7-4968-9952-27d27e5575a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-595298025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7105626-d1f2-48ff-941b-c4808a578ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d8c8f308324d4b8a922110cbd3f5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:53:49Z,use_quota=True,user_id='924904eea0ba416ebaa37f72d1efe087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3966b1e1-2848-4292-8e35-4dfab81c182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3966b1e1-2848-4292-8e35-4dfab81c182b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af020d2-c989-481f-a9c5-8e2e38f03912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af020d2-c989-481f-a9c5-8e2e38f03912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7105626-d1f2-48ff-941b-c4808a578ded', 'volume_name': 'volume-f7105626-d1f2-48ff-941b-c4808a578ded', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eedb2cf-4a34-4f2c-8a27-d0bdb6d07330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eedb2cf-4a34-4f2c-8a27-d0bdb6d07330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248fc59c-63ca-4c5a-b335-5c2613870378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:53:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Volume f7105626-d1f2-48ff-941b-c4808a578ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7105626-d1f2-48ff-941b-c4808a578ded', 'volume_size': 1} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-595298025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7105626-d1f2-48ff-941b-c4808a578ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d8c8f308324d4b8a922110cbd3f5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:53:49Z,use_quota=True,user_id='924904eea0ba416ebaa37f72d1efe087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Creating volume f7105626-d1f2-48ff-941b-c4808a578ded {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:53:49 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:53:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:53:49 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded 1073741824 Sep 29 11:53:49 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:53:50 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Sep 29 11:53:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded 1073741824" returned: 0 in 0.802s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:53:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:53:50 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded Sep 29 11:53:50 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:53:51 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Sep 29 11:53:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded" returned: 0 in 0.364s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:53:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:53:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:53:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248fc59c-63ca-4c5a-b335-5c2613870378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7105626-d1f2-48ff-941b-c4808a578ded', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:53:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e08dea-e85d-4c3a-abb2-b98376605f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:53:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Volume volume-f7105626-d1f2-48ff-941b-c4808a578ded (f7105626-d1f2-48ff-941b-c4808a578ded): created successfully Sep 29 11:53:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e08dea-e85d-4c3a-abb2-b98376605f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:53:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Flow 'volume_create_manager' (fd4adf8d-1aeb-4ce6-ae66-ce757764640a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:53:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bcbfc596-0bce-4f98-83c3-4491bc74b10c tempest-TaggedAttachmentsTest-1259639867 None] Created volume successfully. Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Flow 'volume_create_manager' (fceba4dd-218a-4ce0-93ce-dedfd08b3370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d4c4bf-03c3-4372-bd1b-4c72680ddfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d4c4bf-03c3-4372-bd1b-4c72680ddfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2050804921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0236ff9e-02df-4333-ac35-c5b376487b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb46d3bdef492ab2c1108dd94d5434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:54:00Z,use_quota=True,user_id='412f89b0b6b54f3eb36ef0297e776ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b93eb4-3888-4d3a-bab5-789d1b43c722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b93eb4-3888-4d3a-bab5-789d1b43c722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80dcc40-e799-4ff9-b613-9ad6cea8343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80dcc40-e799-4ff9-b613-9ad6cea8343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0236ff9e-02df-4333-ac35-c5b376487b51', 'volume_name': 'volume-0236ff9e-02df-4333-ac35-c5b376487b51', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec07287-f058-4038-ad61-c2e2e2315a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec07287-f058-4038-ad61-c2e2e2315a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc3122a-cd90-41d6-9556-f28dafa8e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Volume 0236ff9e-02df-4333-ac35-c5b376487b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0236ff9e-02df-4333-ac35-c5b376487b51', 'volume_size': 1} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2050804921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0236ff9e-02df-4333-ac35-c5b376487b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb46d3bdef492ab2c1108dd94d5434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:54:00Z,use_quota=True,user_id='412f89b0b6b54f3eb36ef0297e776ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Creating volume 0236ff9e-02df-4333-ac35-c5b376487b51 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:54:00 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:54:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:00 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 1073741824 Sep 29 11:54:00 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:01 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 1073741824" returned: 0 in 1.115s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:01 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 Sep 29 11:54:01 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:02 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51" returned: 0 in 0.585s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:54:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:54:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc3122a-cd90-41d6-9556-f28dafa8e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0236ff9e-02df-4333-ac35-c5b376487b51', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121e74fc-2b62-48a9-ab79-50a32d7c90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:02 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Volume volume-0236ff9e-02df-4333-ac35-c5b376487b51 (0236ff9e-02df-4333-ac35-c5b376487b51): created successfully Sep 29 11:54:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121e74fc-2b62-48a9-ab79-50a32d7c90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Flow 'volume_create_manager' (fceba4dd-218a-4ce0-93ce-dedfd08b3370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:54:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8af3e2cd-27df-491d-b3bd-8a91c1997ce7 tempest-DeleteServersTestJSON-769259709 None] Created volume successfully. Sep 29 11:54:09 devstack cinder-volume[86117]: WARNING py.warnings [req-8b3e8c52-5a72-4711-ac9d-fd486b55f378 req-d1bfb114-4e10-4e49-b776-0466f30c4eae tempest-DeleteServersTestJSON-769259709 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 29 11:54:09 devstack cinder-volume[86117]: .first() Sep 29 11:54:09 devstack cinder-volume[86117]: Sep 29 11:54:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-8b3e8c52-5a72-4711-ac9d-fd486b55f378 req-d1bfb114-4e10-4e49-b776-0466f30c4eae tempest-DeleteServersTestJSON-769259709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:54:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-8b3e8c52-5a72-4711-ac9d-fd486b55f378 req-d1bfb114-4e10-4e49-b776-0466f30c4eae tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:54:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-8b3e8c52-5a72-4711-ac9d-fd486b55f378 req-d1bfb114-4e10-4e49-b776-0466f30c4eae tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:54:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-8b3e8c52-5a72-4711-ac9d-fd486b55f378 req-d1bfb114-4e10-4e49-b776-0466f30c4eae tempest-DeleteServersTestJSON-769259709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-0236ff9e-02df-4333-ac35-c5b376487b51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca036062-f75d-4db8-a5b6-59665bb9d148', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:54:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-8b3e8c52-5a72-4711-ac9d-fd486b55f378 req-d1bfb114-4e10-4e49-b776-0466f30c4eae tempest-DeleteServersTestJSON-769259709 None] attachment_update completed successfully. Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:12 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:54:12 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:12 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.449s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 6 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:54:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:54:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-3286cf3b-76e8-4266-be84-7dfbf4b0373b req-077fc2cc-3bad-468a-ac81-4b65ff7c3d26 tempest-DeleteServersTestJSON-769259709 None] Terminate volume connection completed successfully. Sep 29 11:54:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-3286cf3b-76e8-4266-be84-7dfbf4b0373b req-077fc2cc-3bad-468a-ac81-4b65ff7c3d26 tempest-DeleteServersTestJSON-769259709 None] Deleting attachment ca036062-f75d-4db8-a5b6-59665bb9d148. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:54:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Acquiring lock "cinder-0236ff9e-02df-4333-ac35-c5b376487b51-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:54:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Lock "cinder-0236ff9e-02df-4333-ac35-c5b376487b51-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:54:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Acquiring lock "cinder-quobyte-0236ff9e-02df-4333-ac35-c5b376487b51" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:54:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Lock "cinder-quobyte-0236ff9e-02df-4333-ac35-c5b376487b51" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:54:19 devstack cinder-volume[86117]: INFO oslo.privsep.daemon [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps130pwce/privsep.sock'] Sep 29 11:54:19 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps130pwce/privsep.sock Sep 29 11:54:19 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 11:54:20 devstack cinder-volume[86117]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 29 11:54:21 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:21 devstack cinder-volume[86117]: INFO oslo.privsep.daemon [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Spawned new privsep daemon via rootwrap Sep 29 11:54:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Accepted privsep connection to /tmp/tmps130pwce/privsep.sock {{(pid=86117) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 29 11:54:21 devstack cinder-volume[86117]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 29 11:54:21 devstack cinder-volume[86117]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 29 11:54:21 devstack cinder-volume[86117]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 29 11:54:21 devstack cinder-volume[86117]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87886 Sep 29 11:54:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6102358-883f-4cfe-973d-9465766ae595]: (2,) {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:54:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8309b83-2fc7-4de6-85ab-a826f939937e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:54:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:21 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 Sep 29 11:54:21 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:21 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51" returned: 0 in 0.557s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:21 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51 Sep 29 11:54:21 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:22 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0236ff9e-02df-4333-ac35-c5b376487b51" returned: 0 in 0.430s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Lock "cinder-quobyte-0236ff9e-02df-4333-ac35-c5b376487b51" released by "delete_volume" :: held 2.543s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:54:22 devstack cinder-volume[86117]: WARNING cinder.quota [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:54:22 devstack cinder-volume[86117]: WARNING cinder.quota [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Created reservations ['445714ed-ada9-4af9-98de-4e413e62f6ea', 'a0bb7c97-2dce-4b51-af4c-7a546b61adae', 'cc3a3b4c-eab4-492c-9a99-38955d733e74', 'baae427b-d921-4f9b-b938-6e83abe7e0e5'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:22 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:54:22 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:22 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:54:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Deleted volume successfully. Sep 29 11:54:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ebdb4d7-f438-4c97-a2f2-7bcb256a2de8 tempest-DeleteServersTestJSON-769259709 None] Lock "cinder-0236ff9e-02df-4333-ac35-c5b376487b51-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Flow 'volume_create_manager' (46691b9a-8ea3-4292-aa15-bc3e39d0d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fa9a83-3e20-4a25-8513-786b17b562dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fa9a83-3e20-4a25-8513-786b17b562dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-922650412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0517e931-8495-43a8-a52d-1346049ea25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f31621fe5f64a099f8d9f996c2a95b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:54:30Z,use_quota=True,user_id='9c3c81b660f14d5296767ebccb9b70a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4abee0f-87ca-4514-b35c-60ddbbe5dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4abee0f-87ca-4514-b35c-60ddbbe5dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3b6b95-72f1-4ba2-9547-cb392eaedebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3b6b95-72f1-4ba2-9547-cb392eaedebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0517e931-8495-43a8-a52d-1346049ea25c', 'volume_name': 'volume-0517e931-8495-43a8-a52d-1346049ea25c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a99ee5e-1ed2-455d-920a-a137bf57c630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a99ee5e-1ed2-455d-920a-a137bf57c630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcb75db-cd6a-4e0f-a450-1c354a88e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Volume 0517e931-8495-43a8-a52d-1346049ea25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0517e931-8495-43a8-a52d-1346049ea25c', 'volume_size': 1} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-922650412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0517e931-8495-43a8-a52d-1346049ea25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f31621fe5f64a099f8d9f996c2a95b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:54:30Z,use_quota=True,user_id='9c3c81b660f14d5296767ebccb9b70a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Creating volume 0517e931-8495-43a8-a52d-1346049ea25c {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:54:30 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:30 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c 1073741824 Sep 29 11:54:30 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:30 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c 1073741824" returned: 0 in 0.683s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:54:31 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c Sep 29 11:54:31 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:54:31 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Sep 29 11:54:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c" returned: 0 in 0.551s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:54:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:54:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:54:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcb75db-cd6a-4e0f-a450-1c354a88e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0517e931-8495-43a8-a52d-1346049ea25c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c8771e-20d7-46ac-bfd0-0b64e18fc1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:54:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Volume volume-0517e931-8495-43a8-a52d-1346049ea25c (0517e931-8495-43a8-a52d-1346049ea25c): created successfully Sep 29 11:54:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c8771e-20d7-46ac-bfd0-0b64e18fc1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:54:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Flow 'volume_create_manager' (46691b9a-8ea3-4292-aa15-bc3e39d0d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:54:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7faf0218-4086-481c-9a79-4ebbe4099866 tempest-ServerActionsTestOtherA-491022715 None] Created volume successfully. Sep 29 11:54:41 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=14,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:54:41 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:55:02 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:55:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-8dac8660-32cb-4027-b217-d6ba853bcb70 req-9f21a3a9-4c99-4085-a495-275dbb3c8602 tempest-TaggedAttachmentsTest-1259639867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-8dac8660-32cb-4027-b217-d6ba853bcb70 req-9f21a3a9-4c99-4085-a495-275dbb3c8602 tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-8dac8660-32cb-4027-b217-d6ba853bcb70 req-9f21a3a9-4c99-4085-a495-275dbb3c8602 tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-8dac8660-32cb-4027-b217-d6ba853bcb70 req-9f21a3a9-4c99-4085-a495-275dbb3c8602 tempest-TaggedAttachmentsTest-1259639867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-f7105626-d1f2-48ff-941b-c4808a578ded', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f62b2741-61d8-4961-a266-6ebb394e7acb', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:55:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-8dac8660-32cb-4027-b217-d6ba853bcb70 req-9f21a3a9-4c99-4085-a495-275dbb3c8602 tempest-TaggedAttachmentsTest-1259639867 None] attachment_update completed successfully. Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.087s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:12 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:55:12 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:12 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.394s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:55:12 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-955699f9-4fe5-44ee-ad79-9d87ab3d7dca req-c49c1f06-d0d7-4ab8-bc72-adb212145b8c tempest-TaggedAttachmentsTest-1259639867 None] Terminate volume connection completed successfully. Sep 29 11:55:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-955699f9-4fe5-44ee-ad79-9d87ab3d7dca req-c49c1f06-d0d7-4ab8-bc72-adb212145b8c tempest-TaggedAttachmentsTest-1259639867 None] Deleting attachment f62b2741-61d8-4961-a266-6ebb394e7acb. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:55:17 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:55:22 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:55:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-b146dd25-9f07-45e4-822e-0f986157dbf1 req-34ea33b7-a787-4f15-a7af-3f84359c5db0 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-b146dd25-9f07-45e4-822e-0f986157dbf1 req-34ea33b7-a787-4f15-a7af-3f84359c5db0 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-b146dd25-9f07-45e4-822e-0f986157dbf1 req-34ea33b7-a787-4f15-a7af-3f84359c5db0 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-b146dd25-9f07-45e4-822e-0f986157dbf1 req-34ea33b7-a787-4f15-a7af-3f84359c5db0 tempest-ServerActionsTestOtherA-491022715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-0517e931-8495-43a8-a52d-1346049ea25c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c81b677f-31db-4224-9a5e-149ad4dae5ce', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:55:23 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-b146dd25-9f07-45e4-822e-0f986157dbf1 req-34ea33b7-a787-4f15-a7af-3f84359c5db0 tempest-ServerActionsTestOtherA-491022715 None] attachment_update completed successfully. Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Acquiring lock "cinder-f7105626-d1f2-48ff-941b-c4808a578ded-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Lock "cinder-f7105626-d1f2-48ff-941b-c4808a578ded-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Acquiring lock "cinder-quobyte-f7105626-d1f2-48ff-941b-c4808a578ded" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Lock "cinder-quobyte-f7105626-d1f2-48ff-941b-c4808a578ded" acquired by "delete_volume" :: waited 0.038s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a879035-0028-4eda-958a-de45aad2f953]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:31 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded Sep 29 11:55:31 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-6fc1d88d-08bf-43e2-9954-2dfd2fac0c84 req-1c595b1f-fa0a-474b-a84b-4387a004b999 tempest-ServerActionsTestOtherA-491022715 None] Terminate volume connection completed successfully. Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-6fc1d88d-08bf-43e2-9954-2dfd2fac0c84 req-1c595b1f-fa0a-474b-a84b-4387a004b999 tempest-ServerActionsTestOtherA-491022715 None] Deleting attachment c81b677f-31db-4224-9a5e-149ad4dae5ce. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Flow 'volume_create_manager' (79197a39-f085-4709-9f73-ace0f3acea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ececa977-1fc9-4bef-aee5-391ab6fb3701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ececa977-1fc9-4bef-aee5-391ab6fb3701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1327555387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d78db7f-b8bb-4689-ae26-62809e045054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4a62f852c84f9483aeb22085ba8b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:55:32Z,use_quota=True,user_id='9283202ae6cd444eaed25f6d24e44099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07b19df-9084-44a0-af4e-7fce49b1b73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07b19df-9084-44a0-af4e-7fce49b1b73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0352ed52-430c-4736-b712-90e48d39dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0352ed52-430c-4736-b712-90e48d39dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d78db7f-b8bb-4689-ae26-62809e045054', 'volume_name': 'volume-6d78db7f-b8bb-4689-ae26-62809e045054', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74978e8c-b24f-4627-ae7d-bb46905dab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74978e8c-b24f-4627-ae7d-bb46905dab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a955566d-df60-44b5-a9c2-ac72f157677e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:32 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Volume 6d78db7f-b8bb-4689-ae26-62809e045054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d78db7f-b8bb-4689-ae26-62809e045054', 'volume_size': 1} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1327555387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d78db7f-b8bb-4689-ae26-62809e045054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4a62f852c84f9483aeb22085ba8b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:55:32Z,use_quota=True,user_id='9283202ae6cd444eaed25f6d24e44099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Creating volume 6d78db7f-b8bb-4689-ae26-62809e045054 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:55:32 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:32 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 1073741824 Sep 29 11:55:32 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:32 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded" returned: 0 in 0.779s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:32 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded Sep 29 11:55:32 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:33 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7105626-d1f2-48ff-941b-c4808a578ded" returned: 0 in 0.840s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Lock "cinder-quobyte-f7105626-d1f2-48ff-941b-c4808a578ded" released by "delete_volume" :: held 1.720s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:33 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Created reservations ['98bea604-3ac2-49fa-b0a2-f32bfac03408', 'b2419998-f8b0-4d06-8158-116f5a6f870c', 'b76722f4-01a8-4c06-a2bc-bd01718b9a22', 'c63db4c5-dc4e-492b-8d20-c0e2d373eb85'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 1073741824" returned: 0 in 1.215s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6fc1d88d-08bf-43e2-9954-2dfd2fac0c84 req-6c23a198-5066-4f87-ba96-aee379f0d00f tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:33 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:55:33 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:34 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 Sep 29 11:55:34 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:34 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054" returned: 0 in 0.329s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6fc1d88d-08bf-43e2-9954-2dfd2fac0c84 req-6c23a198-5066-4f87-ba96-aee379f0d00f tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.541s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:34 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a955566d-df60-44b5-a9c2-ac72f157677e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d78db7f-b8bb-4689-ae26-62809e045054', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba626de-905e-41c4-bef2-486ab8bc284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.416s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:55:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Deleted volume successfully. Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6fc1d88d-08bf-43e2-9954-2dfd2fac0c84 req-6c23a198-5066-4f87-ba96-aee379f0d00f tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.153s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:34 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Volume volume-6d78db7f-b8bb-4689-ae26-62809e045054 (6d78db7f-b8bb-4689-ae26-62809e045054): created successfully Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba626de-905e-41c4-bef2-486ab8bc284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Flow 'volume_create_manager' (79197a39-f085-4709-9f73-ace0f3acea5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-6fc1d88d-08bf-43e2-9954-2dfd2fac0c84 req-6c23a198-5066-4f87-ba96-aee379f0d00f tempest-ServerActionsTestOtherA-491022715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-0517e931-8495-43a8-a52d-1346049ea25c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dd99261-2c97-4578-8660-962e214b41f1', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:55:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-94ec79ce-4ef9-4b3d-97de-caa0d530982b tempest-TaggedAttachmentsTest-1259639867 None] Lock "cinder-f7105626-d1f2-48ff-941b-c4808a578ded-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-aa563e07-c13d-483f-a975-bf3da6a0bbae tempest-ServersNegativeTestJSON-16650180 None] Created volume successfully. Sep 29 11:55:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-6fc1d88d-08bf-43e2-9954-2dfd2fac0c84 req-6c23a198-5066-4f87-ba96-aee379f0d00f tempest-ServerActionsTestOtherA-491022715 None] attachment_update completed successfully. Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Flow 'volume_create_manager' (7fc9fdfe-baed-4892-9ad0-135401d6c5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795e5616-448d-4799-9811-6e9496963431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795e5616-448d-4799-9811-6e9496963431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1029933563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a861c827-bddf-4a1d-a61b-cbbb68d883cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32bbfcfcfca42069790f74e21e46824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:55:35Z,use_quota=True,user_id='6ee208d452144644b659f04c58e2a7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28101fc0-674a-4e12-ba99-700fce69a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28101fc0-674a-4e12-ba99-700fce69a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6832aed-ed43-4d63-89a7-e805ff6cc012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6832aed-ed43-4d63-89a7-e805ff6cc012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a861c827-bddf-4a1d-a61b-cbbb68d883cc', 'volume_name': 'volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2a37ba-1548-45c4-8f42-d1abcbddca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2a37ba-1548-45c4-8f42-d1abcbddca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2689ff6a-7160-457f-b219-5bd3cc392663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:36 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Volume a861c827-bddf-4a1d-a61b-cbbb68d883cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc', 'volume_size': 1} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1029933563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a861c827-bddf-4a1d-a61b-cbbb68d883cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32bbfcfcfca42069790f74e21e46824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:55:35Z,use_quota=True,user_id='6ee208d452144644b659f04c58e2a7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Creating volume a861c827-bddf-4a1d-a61b-cbbb68d883cc {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:55:36 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:36 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc 1073741824 Sep 29 11:55:36 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:36 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc 1073741824" returned: 0 in 0.395s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:38 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc Sep 29 11:55:38 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:39 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Flow 'volume_create_manager' (b8c16fde-88d3-4c12-9883-f2a058ae629b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05db2d7f-bf76-4882-acc0-14a51aa03f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc" returned: 0 in 0.641s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.816s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05db2d7f-bf76-4882-acc0-14a51aa03f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1956747495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e71673-6303-4d4d-95d2-6eab1b77e051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4a62f852c84f9483aeb22085ba8b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:55:39Z,use_quota=True,user_id='9283202ae6cd444eaed25f6d24e44099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f8a441-885f-411f-8af5-12a23fe39e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f8a441-885f-411f-8af5-12a23fe39e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d206d4-885b-40b1-b22b-78285f07a624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d206d4-885b-40b1-b22b-78285f07a624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e71673-6303-4d4d-95d2-6eab1b77e051', 'volume_name': 'volume-23e71673-6303-4d4d-95d2-6eab1b77e051', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2980a10-a442-40fd-88c6-2c12510fa50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2980a10-a442-40fd-88c6-2c12510fa50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6b788-db7c-4847-b5bc-8692dc6bdc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:39 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Volume 23e71673-6303-4d4d-95d2-6eab1b77e051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e71673-6303-4d4d-95d2-6eab1b77e051', 'volume_size': 1} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1956747495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e71673-6303-4d4d-95d2-6eab1b77e051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4a62f852c84f9483aeb22085ba8b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:55:39Z,use_quota=True,user_id='9283202ae6cd444eaed25f6d24e44099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Creating volume 23e71673-6303-4d4d-95d2-6eab1b77e051 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:55:39 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2689ff6a-7160-457f-b219-5bd3cc392663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30dc159c-7af9-4201-a357-bff83b3f6a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:39 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 1073741824 Sep 29 11:55:39 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:39 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Volume volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc (a861c827-bddf-4a1d-a61b-cbbb68d883cc): created successfully Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30dc159c-7af9-4201-a357-bff83b3f6a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Flow 'volume_create_manager' (7fc9fdfe-baed-4892-9ad0-135401d6c5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:55:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2cc9ed92-67a7-4e4a-b85a-2ee47ba713a8 tempest-VolumesAdminNegativeTest-919843202 None] Created volume successfully. Sep 29 11:55:40 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 1073741824" returned: 0 in 0.888s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:40 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 Sep 29 11:55:40 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:40 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051" returned: 0 in 0.509s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6b788-db7c-4847-b5bc-8692dc6bdc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e71673-6303-4d4d-95d2-6eab1b77e051', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b962b-be02-4c36-bcfe-74da35a3e7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:55:40 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Volume volume-23e71673-6303-4d4d-95d2-6eab1b77e051 (23e71673-6303-4d4d-95d2-6eab1b77e051): created successfully Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b962b-be02-4c36-bcfe-74da35a3e7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:55:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Flow 'volume_create_manager' (b8c16fde-88d3-4c12-9883-f2a058ae629b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:55:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-35d37155-c56c-4bed-b38a-f1abf4818fa6 tempest-ServersNegativeTestJSON-16650180 None] Created volume successfully. Sep 29 11:55:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Acquiring lock "cinder-a861c827-bddf-4a1d-a61b-cbbb68d883cc-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Lock "cinder-a861c827-bddf-4a1d-a61b-cbbb68d883cc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Acquiring lock "cinder-quobyte-a861c827-bddf-4a1d-a61b-cbbb68d883cc" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Lock "cinder-quobyte-a861c827-bddf-4a1d-a61b-cbbb68d883cc" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e2cdb-cf85-4699-af32-d2832f050573]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:55:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:41 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc Sep 29 11:55:41 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "cinder-23e71673-6303-4d4d-95d2-6eab1b77e051-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-23e71673-6303-4d4d-95d2-6eab1b77e051-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "cinder-quobyte-23e71673-6303-4d4d-95d2-6eab1b77e051" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-quobyte-23e71673-6303-4d4d-95d2-6eab1b77e051" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b3a91e-1083-4987-8a89-16928c3f9fe5]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:42 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc" returned: 0 in 0.624s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:42 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc Sep 29 11:55:42 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:42 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 Sep 29 11:55:42 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:42 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:42 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051" returned: 0 in 0.688s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a861c827-bddf-4a1d-a61b-cbbb68d883cc" returned: 0 in 0.695s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:42 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051 Sep 29 11:55:42 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Lock "cinder-quobyte-a861c827-bddf-4a1d-a61b-cbbb68d883cc" released by "delete_volume" :: held 1.443s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Created reservations ['9f1922c0-0fba-441b-a5e0-d391b6800ca3', '0ac75a39-a2ac-4881-861c-ec7291063cb9', '762e5cf1-9d07-463d-9898-4bd367a563a9', '191d1752-80d6-4407-8e0f-c07af3cc4e5f'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:43 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-23e71673-6303-4d4d-95d2-6eab1b77e051" returned: 0 in 0.455s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-quobyte-23e71673-6303-4d4d-95d2-6eab1b77e051" released by "delete_volume" :: held 1.212s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:43 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:55:43 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Created reservations ['2248214d-c3fa-4efc-bc5e-9873b7610bb2', '3748fa2f-4103-4cc4-92e6-be3206c2a273', '76edb187-7d5d-4918-b2ea-1f16f226d360', 'b2a85ab8-7e34-4108-9e0a-01d6cfcf3873'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:43 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:55:43 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:43 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:55:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Deleted volume successfully. Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ddbb1c61-cb0d-4a23-a149-e0009d7b3a59 tempest-VolumesAdminNegativeTest-919843202 None] Lock "cinder-a861c827-bddf-4a1d-a61b-cbbb68d883cc-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:43 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.388s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:55:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Deleted volume successfully. Sep 29 11:55:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22b338be-8375-427d-a6eb-aa11b6f4cf36 tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-23e71673-6303-4d4d-95d2-6eab1b77e051-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "cinder-6d78db7f-b8bb-4689-ae26-62809e045054-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-6d78db7f-b8bb-4689-ae26-62809e045054-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "cinder-quobyte-6d78db7f-b8bb-4689-ae26-62809e045054" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:55:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-quobyte-6d78db7f-b8bb-4689-ae26-62809e045054" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:55:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dc4a5-1bc4-4845-8a0b-76841822dc77]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:55:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:45 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 Sep 29 11:55:45 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:45 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054" returned: 0 in 0.944s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:45 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054 Sep 29 11:55:45 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:46 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6d78db7f-b8bb-4689-ae26-62809e045054" returned: 0 in 0.605s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-quobyte-6d78db7f-b8bb-4689-ae26-62809e045054" released by "delete_volume" :: held 1.639s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Created reservations ['bd5f6336-0366-4ca7-9743-9b2051eac190', 'cdad7c90-90fa-479b-9518-1b0ed09f6aee', '2650e87b-8119-41b6-9574-37bf8c8c3fc9', '4b228343-f562-4996-9212-02d4b842e76d'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:55:46 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:55:46 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:55:46 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.465s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:55:46 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:55:46 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Deleted volume successfully. Sep 29 11:55:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75ccd0dd-7a33-4e1f-adf9-366c65d2372b tempest-ServersNegativeTestJSON-16650180 None] Lock "cinder-6d78db7f-b8bb-4689-ae26-62809e045054-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:55:56 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=38,cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:55:56 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=42,cinder:UPDATE=46,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:12 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:56:12 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:12 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.536s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 8 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:56:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:56:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-e3893c00-3140-4371-88db-7b0b1765dab2 req-e60b7172-98de-4ab0-bd84-a307ba6096ee tempest-ServerActionsTestOtherA-491022715 None] Terminate volume connection completed successfully. Sep 29 11:56:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-e3893c00-3140-4371-88db-7b0b1765dab2 req-e60b7172-98de-4ab0-bd84-a307ba6096ee tempest-ServerActionsTestOtherA-491022715 None] Deleting attachment 0dd99261-2c97-4578-8660-962e214b41f1. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:56:23 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:56:23 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Flow 'volume_create_manager' (69dc2792-4ff0-4661-932b-17a5388962e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9e6b2d-1ff0-449d-9e6a-0b749c2ab0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9e6b2d-1ff0-449d-9e6a-0b749c2ab0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-681888649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186f7b3d-2af1-4200-be5c-0826e5833c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f31621fe5f64a099f8d9f996c2a95b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:56:30Z,use_quota=True,user_id='9c3c81b660f14d5296767ebccb9b70a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dd96b1-5402-4766-99cc-0318145fcbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dd96b1-5402-4766-99cc-0318145fcbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efe836e-8bb2-4799-a293-d3c2d69dd202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:56:30 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 11:56:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efe836e-8bb2-4799-a293-d3c2d69dd202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '186f7b3d-2af1-4200-be5c-0826e5833c0f', 'volume_name': 'volume-186f7b3d-2af1-4200-be5c-0826e5833c0f', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:56:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1a1eaf-7502-483a-a3be-0a570c6bf1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:56:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1a1eaf-7502-483a-a3be-0a570c6bf1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:56:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae52eb-9c54-4c0d-9d5f-f62b1958b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:56:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Volume 186f7b3d-2af1-4200-be5c-0826e5833c0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-186f7b3d-2af1-4200-be5c-0826e5833c0f', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 11:56:31 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Trying to clone 186f7b3d-2af1-4200-be5c-0826e5833c0f from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 11:56:32 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 11:56:32 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Image download 20.69 MB at 20.69 MB/s Sep 29 11:56:32 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c569d46-5c8a-4477-a0e3-182d41a60b44]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:56:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:32 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD Sep 29 11:56:32 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:33 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a is fetched for user 9c3c81b660f14d5296767ebccb9b70a2. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3846b78-295b-4a9b-83cc-75d88c8499ff]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:33 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD Sep 29 11:56:33 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:33 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-681888649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186f7b3d-2af1-4200-be5c-0826e5833c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f31621fe5f64a099f8d9f996c2a95b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:56:30Z,use_quota=True,user_id='9c3c81b660f14d5296767ebccb9b70a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Creating volume 186f7b3d-2af1-4200-be5c-0826e5833c0f {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:56:33 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:56:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:33 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f 1073741824 Sep 29 11:56:33 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:34 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f 1073741824" returned: 0 in 0.751s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:34 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f Sep 29 11:56:34 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:35 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f" returned: 0 in 0.479s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Attempting download of 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 186f7b3d-2af1-4200-be5c-0826e5833c0f. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e028d8-a75b-4c48-a000-e2e8e70e35c4]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_a28a0wc0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:35 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_a28a0wc0 Sep 29 11:56:35 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:35 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_a28a0wc0" returned: 0 in 0.376s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_a28a0wc0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:35 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_a28a0wc0 Sep 29 11:56:35 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:36 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_a28a0wc0" returned: 1 in 0.455s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_a28a0wc0' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 11:56:36 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb0062e-54fd-48e5-91dd-ed762d46d32f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:56:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:36 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD Sep 29 11:56:36 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:36 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD" returned: 0 in 0.609s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:36 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] 2eff10fc-36b0-4954-8584-fe8c9e38eb2a was qcow2, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 11:56:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:36 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f Sep 29 11:56:36 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:39 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f" returned: 0 in 2.867s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:39 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_p66t9l3jdevstack@QuobyteHD, size 112.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 11:56:39 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Converted 112.00 MB image at 39.04 MB/s Sep 29 11:56:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:56:39 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f 1G Sep 29 11:56:39 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:56:40 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Sep 29 11:56:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f 1G" returned: 0 in 1.016s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:56:40 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Downloaded image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 186f7b3d-2af1-4200-be5c-0826e5833c0f successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 11:56:40 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a for user 9c3c81b660f14d5296767ebccb9b70a2 is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 11:56:40 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Marking volume 186f7b3d-2af1-4200-be5c-0826e5833c0f as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 11:56:40 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Copying metadata from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a to 186f7b3d-2af1-4200-be5c-0826e5833c0f. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 11:56:40 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Creating volume glance metadata for volume 186f7b3d-2af1-4200-be5c-0826e5833c0f backed by image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 11:56:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae52eb-9c54-4c0d-9d5f-f62b1958b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186f7b3d-2af1-4200-be5c-0826e5833c0f', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:56:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def94a0c-94e6-4ed8-ad1b-45e4799a2423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:56:41 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Volume volume-186f7b3d-2af1-4200-be5c-0826e5833c0f (186f7b3d-2af1-4200-be5c-0826e5833c0f): created successfully Sep 29 11:56:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def94a0c-94e6-4ed8-ad1b-45e4799a2423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:56:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Flow 'volume_create_manager' (69dc2792-4ff0-4661-932b-17a5388962e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:56:41 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9d85f60e-f272-4fae-8e2a-2bac3a33135b tempest-ServerActionsTestOtherA-491022715 None] Created volume successfully. Sep 29 11:56:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-aeb9bde3-0f12-4033-8069-4ef48f41db5a req-1b1d6e2d-6400-450b-8def-c3b790f3beed tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:56:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-aeb9bde3-0f12-4033-8069-4ef48f41db5a req-1b1d6e2d-6400-450b-8def-c3b790f3beed tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:56:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-aeb9bde3-0f12-4033-8069-4ef48f41db5a req-1b1d6e2d-6400-450b-8def-c3b790f3beed tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:56:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-aeb9bde3-0f12-4033-8069-4ef48f41db5a req-1b1d6e2d-6400-450b-8def-c3b790f3beed tempest-ServerActionsTestOtherA-491022715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-186f7b3d-2af1-4200-be5c-0826e5833c0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2aee4272-fff4-42cb-a21e-5a6b2cd6b4fa', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:56:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-aeb9bde3-0f12-4033-8069-4ef48f41db5a req-1b1d6e2d-6400-450b-8def-c3b790f3beed tempest-ServerActionsTestOtherA-491022715 None] attachment_update completed successfully. Sep 29 11:56:59 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=7,cinder:SELECT=17,cinder:INSERT=7 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Flow 'volume_create_manager' (9200e5fd-cf30-4d73-afe2-c6f7345de711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc5b03c-a1e0-4ddc-8889-db77840beedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc5b03c-a1e0-4ddc-8889-db77840beedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-423823058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ee591b-8f9b-405b-b43f-f0fd5c0b408a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9eb1939de541deb0216343c9ed14f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:57:01Z,use_quota=True,user_id='386132057f574a4e812d17bfa8f57f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94701e1e-f172-4296-b099-a29974550baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94701e1e-f172-4296-b099-a29974550baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a29409-047a-46fd-a6fd-606ede648247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a29409-047a-46fd-a6fd-606ede648247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24ee591b-8f9b-405b-b43f-f0fd5c0b408a', 'volume_name': 'volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff4d1af-6c6a-462f-9a4f-be2b5d63b5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff4d1af-6c6a-462f-9a4f-be2b5d63b5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e751443-32d1-42fb-9b41-c712569cad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Volume 24ee591b-8f9b-405b-b43f-f0fd5c0b408a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a', 'volume_size': 1} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-423823058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ee591b-8f9b-405b-b43f-f0fd5c0b408a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9eb1939de541deb0216343c9ed14f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:57:01Z,use_quota=True,user_id='386132057f574a4e812d17bfa8f57f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Creating volume 24ee591b-8f9b-405b-b43f-f0fd5c0b408a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:57:00 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:57:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:01 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a 1073741824 Sep 29 11:57:01 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:01 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a 1073741824" returned: 0 in 0.913s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:02 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a Sep 29 11:57:02 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:02 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a" returned: 0 in 0.620s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:57:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e751443-32d1-42fb-9b41-c712569cad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76f6f82-1759-4032-b697-8fa36b45e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:02 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Volume volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a (24ee591b-8f9b-405b-b43f-f0fd5c0b408a): created successfully Sep 29 11:57:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76f6f82-1759-4032-b697-8fa36b45e49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Flow 'volume_create_manager' (9200e5fd-cf30-4d73-afe2-c6f7345de711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:57:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-34ba56f1-1832-490a-a33e-f999f4d6ee05 tempest-ServerRescueNegativeTestJSON-1882448008 None] Created volume successfully. Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:12 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:57:12 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:12 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.574s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:57:12 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:57:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Flow 'volume_create_manager' (8cd43f73-dd8c-4b06-8dc6-4cdba2690094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ada96f1-adf4-47de-9d64-d3e19de156cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ada96f1-adf4-47de-9d64-d3e19de156cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-698195916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cdbd50-a27d-4307-9c25-fbdab415d7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e622ae2f1f2548c8a325ed4ecf6d17fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:57:17Z,use_quota=True,user_id='ba7012f512384a5ab13b4112dd698d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cd45b3-afad-4f1b-b192-39ef6b7b3f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cd45b3-afad-4f1b-b192-39ef6b7b3f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bff841-1cb2-4491-be0f-bbe35117c615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bff841-1cb2-4491-be0f-bbe35117c615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cdbd50-a27d-4307-9c25-fbdab415d7ea', 'volume_name': 'volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e330769-3597-4bdc-8ba1-bbfe43758775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e330769-3597-4bdc-8ba1-bbfe43758775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f862e38-f04a-4264-be04-51e31fc3641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Volume 77cdbd50-a27d-4307-9c25-fbdab415d7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea', 'volume_size': 1} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-698195916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cdbd50-a27d-4307-9c25-fbdab415d7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e622ae2f1f2548c8a325ed4ecf6d17fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:57:17Z,use_quota=True,user_id='ba7012f512384a5ab13b4112dd698d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Creating volume 77cdbd50-a27d-4307-9c25-fbdab415d7ea {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:57:17 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:57:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:17 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea 1073741824 Sep 29 11:57:17 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:18 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea 1073741824" returned: 0 in 1.348s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:18 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea Sep 29 11:57:18 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:19 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea" returned: 0 in 0.392s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f862e38-f04a-4264-be04-51e31fc3641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18952ff8-f843-4b6a-a9a5-c0dd8ffd48d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Volume volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea (77cdbd50-a27d-4307-9c25-fbdab415d7ea): created successfully Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18952ff8-f843-4b6a-a9a5-c0dd8ffd48d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Flow 'volume_create_manager' (8cd43f73-dd8c-4b06-8dc6-4cdba2690094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:57:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a5fb25d6-515c-4f5d-8d4a-5bd2e800833e tempest-AttachVolumeNegativeTest-959773852 None] Created volume successfully. Sep 29 11:57:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-75fbb31b-e70a-48ab-b7e5-e9bbec048310 req-27f88c16-69fb-4f71-82c2-8b921c010e2e tempest-ServerActionsTestOtherA-491022715 None] Terminate volume connection completed successfully. Sep 29 11:57:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-75fbb31b-e70a-48ab-b7e5-e9bbec048310 req-27f88c16-69fb-4f71-82c2-8b921c010e2e tempest-ServerActionsTestOtherA-491022715 None] Deleting attachment 2aee4272-fff4-42cb-a21e-5a6b2cd6b4fa. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:57:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-507020b6-a7a3-42b0-80d1-374d4ecd3f7d req-0d41e71e-e595-4ec5-b657-3ce07eed9272 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-507020b6-a7a3-42b0-80d1-374d4ecd3f7d req-0d41e71e-e595-4ec5-b657-3ce07eed9272 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-507020b6-a7a3-42b0-80d1-374d4ecd3f7d req-0d41e71e-e595-4ec5-b657-3ce07eed9272 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-507020b6-a7a3-42b0-80d1-374d4ecd3f7d req-0d41e71e-e595-4ec5-b657-3ce07eed9272 tempest-AttachVolumeNegativeTest-959773852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd9d4db4-09af-40d2-b293-cd6fcee8fe9e', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:57:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-507020b6-a7a3-42b0-80d1-374d4ecd3f7d req-0d41e71e-e595-4ec5-b657-3ce07eed9272 tempest-AttachVolumeNegativeTest-959773852 None] attachment_update completed successfully. Sep 29 11:57:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-75fbb31b-e70a-48ab-b7e5-e9bbec048310 req-e233ff5a-4e3b-413d-a8c0-2bc9846886ac tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-75fbb31b-e70a-48ab-b7e5-e9bbec048310 req-e233ff5a-4e3b-413d-a8c0-2bc9846886ac tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-75fbb31b-e70a-48ab-b7e5-e9bbec048310 req-e233ff5a-4e3b-413d-a8c0-2bc9846886ac tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-75fbb31b-e70a-48ab-b7e5-e9bbec048310 req-e233ff5a-4e3b-413d-a8c0-2bc9846886ac tempest-ServerActionsTestOtherA-491022715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-186f7b3d-2af1-4200-be5c-0826e5833c0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '466c3572-38b2-4738-93d6-13eb69754d85', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:57:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-75fbb31b-e70a-48ab-b7e5-e9bbec048310 req-e233ff5a-4e3b-413d-a8c0-2bc9846886ac tempest-ServerActionsTestOtherA-491022715 None] attachment_update completed successfully. Sep 29 11:57:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Acquiring lock "cinder-24ee591b-8f9b-405b-b43f-f0fd5c0b408a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:57:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "cinder-24ee591b-8f9b-405b-b43f-f0fd5c0b408a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:57:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Acquiring lock "cinder-quobyte-24ee591b-8f9b-405b-b43f-f0fd5c0b408a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:57:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "cinder-quobyte-24ee591b-8f9b-405b-b43f-f0fd5c0b408a" acquired by "delete_volume" :: waited 0.062s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:57:25 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb41a5d-df3d-471e-aac5-ce06ae1bdc0e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:57:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:26 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a Sep 29 11:57:26 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:27 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a" returned: 0 in 1.223s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:27 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a Sep 29 11:57:27 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:27 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24ee591b-8f9b-405b-b43f-f0fd5c0b408a" returned: 0 in 0.318s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "cinder-quobyte-24ee591b-8f9b-405b-b43f-f0fd5c0b408a" released by "delete_volume" :: held 1.683s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Created reservations ['5f88655f-4051-4efb-b0af-722ba8c8ffdb', '38d2e8e6-2da4-4535-aee8-f67ec0efb28b', 'd06bd592-fe2c-4f0f-bf41-db68572c78bf', '7238ce0b-0c96-40fe-b91d-f2659c0feb52'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:27 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:57:27 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:28 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.664s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:28 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:57:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Deleted volume successfully. Sep 29 11:57:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b94d5acd-af57-4fbd-9f59-9cff2ff811ef tempest-ServerRescueNegativeTestJSON-1882448008 None] Lock "cinder-24ee591b-8f9b-405b-b43f-f0fd5c0b408a-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:57:37 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=19,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:57:38 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=23,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Flow 'volume_create_manager' (4dddd477-6bca-4cee-b345-420deaae4baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f967a-380f-42d6-a959-74c92a1f4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f967a-380f-42d6-a959-74c92a1f4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-561602831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f475312-7bdf-4d6d-8f6b-4149c600013c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b9ed949df426bb1e08b46253ad750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:57:52Z,use_quota=True,user_id='3e78b6634d6047ae908b1c4fbee30849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dd737c-a981-404c-b89d-8bd3a1bca2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dd737c-a981-404c-b89d-8bd3a1bca2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3f7668-d9ea-4d01-9251-2d380bc1fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3f7668-d9ea-4d01-9251-2d380bc1fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f475312-7bdf-4d6d-8f6b-4149c600013c', 'volume_name': 'volume-7f475312-7bdf-4d6d-8f6b-4149c600013c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f38036-594f-45b5-8e8a-44620c705f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f38036-594f-45b5-8e8a-44620c705f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed136cac-b73b-491b-9c8a-5e92703a7e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Volume 7f475312-7bdf-4d6d-8f6b-4149c600013c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f475312-7bdf-4d6d-8f6b-4149c600013c', 'volume_size': 1} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-561602831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f475312-7bdf-4d6d-8f6b-4149c600013c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b9ed949df426bb1e08b46253ad750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:57:52Z,use_quota=True,user_id='3e78b6634d6047ae908b1c4fbee30849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Creating volume 7f475312-7bdf-4d6d-8f6b-4149c600013c {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:57:52 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:52 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c 1073741824 Sep 29 11:57:52 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:52 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c 1073741824" returned: 0 in 0.588s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:57:53 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c Sep 29 11:57:53 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:57:53 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c" returned: 0 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed136cac-b73b-491b-9c8a-5e92703a7e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f475312-7bdf-4d6d-8f6b-4149c600013c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ba9d6-cbd1-403d-9016-cff83ecdbe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:57:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Volume volume-7f475312-7bdf-4d6d-8f6b-4149c600013c (7f475312-7bdf-4d6d-8f6b-4149c600013c): created successfully Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ba9d6-cbd1-403d-9016-cff83ecdbe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:57:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Flow 'volume_create_manager' (4dddd477-6bca-4cee-b345-420deaae4baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:57:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-51ce4f54-7e2c-4184-964b-5952911ee9e7 tempest-AttachVolumeTestJSON-1539224374 None] Created volume successfully. Sep 29 11:57:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-68d3c365-fc08-4c7a-b0cf-12e6bb73a260 req-ff23d2b2-1700-455e-bdd7-e9ddd79f92c4 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:57:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-68d3c365-fc08-4c7a-b0cf-12e6bb73a260 req-ff23d2b2-1700-455e-bdd7-e9ddd79f92c4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:57:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-68d3c365-fc08-4c7a-b0cf-12e6bb73a260 req-ff23d2b2-1700-455e-bdd7-e9ddd79f92c4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:57:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-68d3c365-fc08-4c7a-b0cf-12e6bb73a260 req-ff23d2b2-1700-455e-bdd7-e9ddd79f92c4 tempest-AttachVolumeTestJSON-1539224374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-7f475312-7bdf-4d6d-8f6b-4149c600013c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27711cd9-ebab-4eac-b3e5-9a1da19d97eb', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:57:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-68d3c365-fc08-4c7a-b0cf-12e6bb73a260 req-ff23d2b2-1700-455e-bdd7-e9ddd79f92c4 tempest-AttachVolumeTestJSON-1539224374 None] attachment_update completed successfully. Sep 29 11:58:05 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:58:05 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1,cinder:SELECT=6 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:58:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-42ba4f73-27c3-415d-a1d1-a8cded68c4a7 tempest-ServerActionsTestOtherA-491022715 None] Terminate volume connection completed successfully. Sep 29 11:58:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-42ba4f73-27c3-415d-a1d1-a8cded68c4a7 tempest-ServerActionsTestOtherA-491022715 None] Deleting attachment 466c3572-38b2-4738-93d6-13eb69754d85. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:58:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "cinder-186f7b3d-2af1-4200-be5c-0826e5833c0f-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:58:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-186f7b3d-2af1-4200-be5c-0826e5833c0f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:58:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "cinder-quobyte-186f7b3d-2af1-4200-be5c-0826e5833c0f" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:58:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-quobyte-186f7b3d-2af1-4200-be5c-0826e5833c0f" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:58:06 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40a8f5c-cc1a-4dea-a633-92f0255553b1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:58:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:06 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f Sep 29 11:58:06 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:07 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f" returned: 0 in 0.681s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:07 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f Sep 29 11:58:07 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:07 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-186f7b3d-2af1-4200-be5c-0826e5833c0f" returned: 0 in 0.666s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-quobyte-186f7b3d-2af1-4200-be5c-0826e5833c0f" released by "delete_volume" :: held 1.437s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG cinder.quota [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Created reservations ['b1d92cbf-57fe-4581-8a0e-9d875beef1da', 'b231d328-b1cd-4013-885b-90ebf0d227ac', 'e32d8853-a126-4875-b88f-3ff40c689dbe', '9d708a62-bd3c-43dd-ac0b-a418a3bf4d3c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:08 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:58:08 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:08 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.250s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG cinder.manager [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:58:08 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Deleted volume successfully. Sep 29 11:58:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-d91c7aa1-7cac-42b1-9e42-928d6b0e1eb5 req-08bac331-c0b9-4efb-b870-1aa9d4bbbdd1 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-186f7b3d-2af1-4200-be5c-0826e5833c0f-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:58:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "cinder-0517e931-8495-43a8-a52d-1346049ea25c-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:58:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-0517e931-8495-43a8-a52d-1346049ea25c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:58:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "cinder-quobyte-0517e931-8495-43a8-a52d-1346049ea25c" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:58:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-quobyte-0517e931-8495-43a8-a52d-1346049ea25c" acquired by "delete_volume" :: waited 0.043s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:58:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[81632318-4d54-4cda-94ce-39aeda072872]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:58:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:10 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c Sep 29 11:58:10 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:10 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c" returned: 0 in 0.633s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:10 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c Sep 29 11:58:10 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:10 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0517e931-8495-43a8-a52d-1346049ea25c" returned: 0 in 0.500s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-quobyte-0517e931-8495-43a8-a52d-1346049ea25c" released by "delete_volume" :: held 1.261s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Created reservations ['24227982-466f-4416-a065-247965bc4680', '8e497243-6c2a-408b-bf7c-b24b93796588', 'ceb1019d-14eb-4d4d-a206-8b270b151f03', 'f3b40fb1-0017-4b32-94b1-c56a4306064e'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:11 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:58:11 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:11 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.482s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:58:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Deleted volume successfully. Sep 29 11:58:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-64ee19fb-0f00-43dd-bc66-e199b9ba3ca3 tempest-ServerActionsTestOtherA-491022715 None] Lock "cinder-0517e931-8495-43a8-a52d-1346049ea25c-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:12 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:58:12 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:12 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.522s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:58:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:58:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-cc383f90-b1aa-49e1-a3b2-cc2011f886e1 req-939cdb99-8b94-4197-a020-7bbc83c8fd1c tempest-AttachVolumeNegativeTest-959773852 None] Terminate volume connection completed successfully. Sep 29 11:58:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-cc383f90-b1aa-49e1-a3b2-cc2011f886e1 req-939cdb99-8b94-4197-a020-7bbc83c8fd1c tempest-AttachVolumeNegativeTest-959773852 None] Deleting attachment dd9d4db4-09af-40d2-b293-cd6fcee8fe9e. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:58:27 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:58:27 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=10,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:58:30 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-61251a22-7a25-46d4-b51b-5915cf4f0e51 req-c4169b2f-29c1-497d-b229-13be4a593a9d tempest-AttachVolumeTestJSON-1539224374 None] Terminate volume connection completed successfully. Sep 29 11:58:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-61251a22-7a25-46d4-b51b-5915cf4f0e51 req-c4169b2f-29c1-497d-b229-13be4a593a9d tempest-AttachVolumeTestJSON-1539224374 None] Deleting attachment 27711cd9-ebab-4eac-b3e5-9a1da19d97eb. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:58:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bfae8838-258e-4c0c-af70-e77404a02d04 tempest-BackendsCapabilitiesAdminTestsJSON-1255778056 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0487976074219, 'free_capacity_gb': 1775.0487976074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86117) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 11:58:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e3488550-510f-46d7-b5fb-5f747005050a tempest-BackendsCapabilitiesAdminTestsJSON-1255778056 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0487976074219, 'free_capacity_gb': 1775.0487976074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86117) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 11:58:40 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:58:40 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:58:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-50be61fa-95d2-4218-a1ad-e11da444297d tempest-GroupSnapshotsTest-335565575 None] Group tempest-GroupSnapshotsTest-Group-1651200761: creating Sep 29 11:58:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-50be61fa-95d2-4218-a1ad-e11da444297d tempest-GroupSnapshotsTest-335565575 None] Group tempest-GroupSnapshotsTest-Group-1651200761: created successfully Sep 29 11:58:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-50be61fa-95d2-4218-a1ad-e11da444297d tempest-GroupSnapshotsTest-335565575 None] Create group completed successfully. Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (e9824bb4-c5b6-45e4-a3a1-d6409925e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4298abd-0a56-4c27-bdc2-2677233547e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4298abd-0a56-4c27-bdc2-2677233547e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002790346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c09f092-d4e3-4d78-ad0c-30ababa07d5f,host='devstack@QuobyteHD#QuobyteHD',id=34f6fe76-04ce-4168-aab8-471b6345d779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:58:47Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(121ab52a-bc69-4a85-8470-fe0eda220639),volume_type_id=121ab52a-bc69-4a85-8470-fe0eda220639)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25970644-0f20-45a2-8f7f-a0aaf1e511b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25970644-0f20-45a2-8f7f-a0aaf1e511b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a3346e-aecb-4d5b-a026-c57d1c1b298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a3346e-aecb-4d5b-a026-c57d1c1b298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f6fe76-04ce-4168-aab8-471b6345d779', 'volume_name': 'volume-34f6fe76-04ce-4168-aab8-471b6345d779', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b3d7bb-9039-46a9-9de8-691e35e27eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b3d7bb-9039-46a9-9de8-691e35e27eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbdba8f-8b74-4c4c-a840-36882f295844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:46 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Volume 34f6fe76-04ce-4168-aab8-471b6345d779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f6fe76-04ce-4168-aab8-471b6345d779', 'volume_size': 1} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c09f092-d4e3-4d78-ad0c-30ababa07d5f,created_at=2026-09-29T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002790346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c09f092-d4e3-4d78-ad0c-30ababa07d5f,host='devstack@QuobyteHD#QuobyteHD',id=34f6fe76-04ce-4168-aab8-471b6345d779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:58:47Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(121ab52a-bc69-4a85-8470-fe0eda220639),volume_type_id=121ab52a-bc69-4a85-8470-fe0eda220639)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Creating volume 34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:58:46 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:58:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:47 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 1073741824 Sep 29 11:58:47 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Flow 'volume_create_manager' (59eef358-1571-4c3d-b1e7-7fb19fa18bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8cfe7b-ce48-4a7f-8e2f-163fdde65c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8cfe7b-ce48-4a7f-8e2f-163fdde65c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-515201194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddabf7ae-1800-41b4-947d-2766678522f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4742a0284a3b44e29399b22d4a752a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:58:47Z,use_quota=True,user_id='1ceccc157dc64236bd542d139c630f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ec24a0-70c6-496e-bf8d-4046d761234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ec24a0-70c6-496e-bf8d-4046d761234b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebf7b97-0ba4-4a9e-ab8c-2b6cd230594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebf7b97-0ba4-4a9e-ab8c-2b6cd230594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddabf7ae-1800-41b4-947d-2766678522f2', 'volume_name': 'volume-ddabf7ae-1800-41b4-947d-2766678522f2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd636e7-cfa6-4994-a762-9666d570be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd636e7-cfa6-4994-a762-9666d570be7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6503d575-ea37-4714-97ea-fa4f9c48070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:47 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Volume ddabf7ae-1800-41b4-947d-2766678522f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddabf7ae-1800-41b4-947d-2766678522f2', 'volume_size': 1} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:47 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 1073741824" returned: 0 in 0.685s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:47 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 Sep 29 11:58:47 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:48 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779" returned: 0 in 0.412s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-515201194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddabf7ae-1800-41b4-947d-2766678522f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4742a0284a3b44e29399b22d4a752a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:58:47Z,use_quota=True,user_id='1ceccc157dc64236bd542d139c630f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Creating volume ddabf7ae-1800-41b4-947d-2766678522f2 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:58:48 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbdba8f-8b74-4c4c-a840-36882f295844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f6fe76-04ce-4168-aab8-471b6345d779', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:48 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 1073741824 Sep 29 11:58:48 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820d6bc8-d05f-404c-8177-fa7b27b775f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:48 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Volume volume-34f6fe76-04ce-4168-aab8-471b6345d779 (34f6fe76-04ce-4168-aab8-471b6345d779): created successfully Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820d6bc8-d05f-404c-8177-fa7b27b775f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (e9824bb4-c5b6-45e4-a3a1-d6409925e34e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:58:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fb848c31-70e5-44ab-a9aa-903611151099 tempest-GroupSnapshotsTest-335565575 None] Created volume successfully. Sep 29 11:58:48 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 1073741824" returned: 0 in 0.499s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:48 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 Sep 29 11:58:48 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:48 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2" returned: 0 in 0.303s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6503d575-ea37-4714-97ea-fa4f9c48070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddabf7ae-1800-41b4-947d-2766678522f2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee4b0ac-4232-4c12-a4c6-c6c83d946c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:58:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Volume volume-ddabf7ae-1800-41b4-947d-2766678522f2 (ddabf7ae-1800-41b4-947d-2766678522f2): created successfully Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee4b0ac-4232-4c12-a4c6-c6c83d946c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Flow 'volume_create_manager' (59eef358-1571-4c3d-b1e7-7fb19fa18bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:58:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f97ecc78-41f5-44be-b658-442edd441bc7 tempest-AttachVolumeShelveTestJSON-125540134 None] Created volume successfully. Sep 29 11:58:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] GroupSnapshot 739d6fe2-339b-4bc4-b26e-c78113fdb31f: creating. Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Group snapshot 739d6fe2-339b-4bc4-b26e-c78113fdb31f: creating. {{(pid=86117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Creating offline snapshot 6fb76668-008f-4949-8b7e-f7d24f46efa0 of volume 34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f807d-ef9e-48e4-b17e-4db98324acef]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:58:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:49 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 Sep 29 11:58:49 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:50 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779" returned: 0 in 0.476s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:50 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 1G Sep 29 11:58:50 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:50 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 1G" returned: 0 in 0.544s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f6fe76-04ce-4168-aab8-471b6345d779 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:50 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f6fe76-04ce-4168-aab8-471b6345d779 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 Sep 29 11:58:50 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:51 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f6fe76-04ce-4168-aab8-471b6345d779 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:51 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:58:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:51 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 Sep 29 11:58:51 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:51 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:51 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.info Sep 29 11:58:51 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:51 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.info" returned: 0 in 0.435s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:51 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:58:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:51 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.info Sep 29 11:58:52 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:52 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.info" returned: 0 in 0.518s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:52 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-55952717-cb8d-4b1f-b67f-134e492df759 tempest-GroupSnapshotsTest-335565575 None] group_snapshot 739d6fe2-339b-4bc4-b26e-c78113fdb31f: created successfully Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-6fb76668-008f-4949-8b7e-f7d24f46efa0-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6fb76668-008f-4949-8b7e-f7d24f46efa0-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Creating volume bddf9c57-dc92-4a4b-81a6-28ff15d31a98 from snapshot 6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] snapshot: 6fb76668-008f-4949-8b7e-f7d24f46efa0, volume: bddf9c57-dc92-4a4b-81a6-28ff15d31a98, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b23823-bcfd-4fba-954d-4cc7fdf89962]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:54 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 Sep 29 11:58:54 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:54 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0" returned: 0 in 0.573s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f6fe76-04ce-4168-aab8-471b6345d779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e50d16-da75-469d-a621-3ce7babb4b02]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:58:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:55 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 Sep 29 11:58:55 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:58:55 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 29 11:58:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779" returned: 0 in 0.423s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:58:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 11:58:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 11:58:55 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 11:58:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:58:55 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 Sep 29 11:58:55 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:04 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:59:04 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=16,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 11:59:05 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" returned: 0 in 10.054s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:05 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779, size 1024.00 MB, duration 10.06 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 11:59:05 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Converted 1024.00 MB image at 101.83 MB/s Sep 29 11:59:05 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:59:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:05 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 Sep 29 11:59:05 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:05 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-9bf20bd0-79a7-43ae-bc52-8689eeb80f01 req-bc723af2-8c5d-4184-b675-0e8755c1c9a3 tempest-AttachVolumeShelveTestJSON-125540134 None] No connector for attachment 8241ecef-86fa-47bf-bf04-6c6f37739117; skipping storage backend terminate_connection call. {{(pid=86117) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 29 11:59:05 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-9bf20bd0-79a7-43ae-bc52-8689eeb80f01 req-bc723af2-8c5d-4184-b675-0e8755c1c9a3 tempest-AttachVolumeShelveTestJSON-125540134 None] Deleting attachment 8241ecef-86fa-47bf-bf04-6c6f37739117. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:59:05 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" returned: 0 in 0.484s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" released by "_copy_volume_from_snapshot" :: held 11.670s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6fb76668-008f-4949-8b7e-f7d24f46efa0-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" released by "_create_volume_from_snapshot" :: held 11.745s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.764s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f2871899-106e-4560-813d-a854e58ae654 tempest-GroupSnapshotsTest-335565575 None] Create group from source-snapshot-739d6fe2-339b-4bc4-b26e-c78113fdb31f completed successfully. Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Flow 'volume_create_manager' (a39e91ea-0af0-4235-9753-a177abc9290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16329ea8-9773-4e30-8876-ece3e55713c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16329ea8-9773-4e30-8876-ece3e55713c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-118069361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab109ba-fd42-4a97-808b-497ce07b967e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e622ae2f1f2548c8a325ed4ecf6d17fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:07Z,use_quota=True,user_id='ba7012f512384a5ab13b4112dd698d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81da32ba-b592-475e-b9b7-538631fe63ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81da32ba-b592-475e-b9b7-538631fe63ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54ee14b-55c1-464d-84ed-2cf026b50505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54ee14b-55c1-464d-84ed-2cf026b50505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab109ba-fd42-4a97-808b-497ce07b967e', 'volume_name': 'volume-9ab109ba-fd42-4a97-808b-497ce07b967e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da381316-2c13-4e59-91b9-7d6e9982c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da381316-2c13-4e59-91b9-7d6e9982c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85c0e42-be2f-4585-b07c-efbd81dca627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:06 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Volume 9ab109ba-fd42-4a97-808b-497ce07b967e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab109ba-fd42-4a97-808b-497ce07b967e', 'volume_size': 1} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-118069361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab109ba-fd42-4a97-808b-497ce07b967e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e622ae2f1f2548c8a325ed4ecf6d17fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:07Z,use_quota=True,user_id='ba7012f512384a5ab13b4112dd698d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Creating volume 9ab109ba-fd42-4a97-808b-497ce07b967e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:59:06 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:59:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:06 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e 1073741824 Sep 29 11:59:06 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:07 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e 1073741824" returned: 0 in 0.574s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:07 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e Sep 29 11:59:07 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:07 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e" returned: 0 in 0.323s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85c0e42-be2f-4585-b07c-efbd81dca627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab109ba-fd42-4a97-808b-497ce07b967e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64f9808-6ab5-4521-a162-59fff48d8cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:07 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Volume volume-9ab109ba-fd42-4a97-808b-497ce07b967e (9ab109ba-fd42-4a97-808b-497ce07b967e): created successfully Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64f9808-6ab5-4521-a162-59fff48d8cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Flow 'volume_create_manager' (a39e91ea-0af0-4235-9753-a177abc9290e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6c390b13-4ce8-4512-a340-6e9fd75337be tempest-AttachVolumeNegativeTest-959773852 None] Created volume successfully. Sep 29 11:59:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[238eb5d3-668e-423b-b560-45c79d681585]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:08 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 Sep 29 11:59:08 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:08 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" returned: 0 in 0.481s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:08 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98 Sep 29 11:59:08 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:08 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-bddf9c57-dc92-4a4b-81a6-28ff15d31a98" released by "delete_volume" :: held 0.858s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:08 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Created reservations ['0381a27e-8619-4197-964d-1be9873a7cb0'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:08 devstack cinder-volume[86117]: WARNING cinder.quota [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2021161482 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2021161482, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:08 devstack cinder-volume[86117]: WARNING cinder.quota [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2021161482 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2021161482, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Created reservations ['d8cf814d-feed-4ab9-ae99-07ce6f5dfaf3', '17db31d6-2f36-4b45-be1f-a6e6cbaea16f', 'afdd31f8-3d4c-422e-83f3-37a682e67ed1', 'ca2ccbca-48f1-4607-9dc8-5831f697bc75'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:09 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:59:09 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:09 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.341s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:59:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b6c90a5b-49d4-4435-a4ec-39c89a80b55d tempest-GroupSnapshotsTest-335565575 None] Delete group completed successfully. Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-fdf7a733-141b-4039-8878-1e4c840bba84 req-37dd5062-ed0c-42f7-bc68-0b79db20b7dd tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-fdf7a733-141b-4039-8878-1e4c840bba84 req-37dd5062-ed0c-42f7-bc68-0b79db20b7dd tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-fdf7a733-141b-4039-8878-1e4c840bba84 req-37dd5062-ed0c-42f7-bc68-0b79db20b7dd tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-fdf7a733-141b-4039-8878-1e4c840bba84 req-37dd5062-ed0c-42f7-bc68-0b79db20b7dd tempest-AttachVolumeNegativeTest-959773852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-9ab109ba-fd42-4a97-808b-497ce07b967e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab3c8e80-6428-4b18-9deb-9d68bf383811', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:59:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-fdf7a733-141b-4039-8878-1e4c840bba84 req-37dd5062-ed0c-42f7-bc68-0b79db20b7dd tempest-AttachVolumeNegativeTest-959773852 None] attachment_update completed successfully. Sep 29 11:59:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] group_snapshot 739d6fe2-339b-4bc4-b26e-c78113fdb31f: deleting Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] group_snapshot 739d6fe2-339b-4bc4-b26e-c78113fdb31f: deleting {{(pid=86117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-34f6fe76-04ce-4168-aab8-471b6345d779" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-34f6fe76-04ce-4168-aab8-471b6345d779" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-6fb76668-008f-4949-8b7e-f7d24f46efa0" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6fb76668-008f-4949-8b7e-f7d24f46efa0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Deleting offline snapshot 6fb76668-008f-4949-8b7e-f7d24f46efa0 of volume 34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] snapshot_file for this snap is: volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387680c-413e-489f-8db7-9a57d39bf555]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:10 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 Sep 29 11:59:10 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:11 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0" returned: 0 in 0.683s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f6fe76-04ce-4168-aab8-471b6345d779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 11:59:11 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a284db2-0184-42de-981b-e0d0146822f9]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:11 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 Sep 29 11:59:11 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:12 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:59:12 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:12 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779" returned: 0 in 0.783s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:12 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 Sep 29 11:59:12 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:12 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.414s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 11:59:12 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0" returned: 0 in 0.477s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:12 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0 Sep 29 11:59:12 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:13 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779.6fb76668-008f-4949-8b7e-f7d24f46efa0" returned: 0 in 0.385s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6fb76668-008f-4949-8b7e-f7d24f46efa0" released by "_delete_snapshot" :: held 2.510s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-34f6fe76-04ce-4168-aab8-471b6345d779" released by "delete_snapshot" :: held 2.539s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:13 devstack cinder-volume[86117]: WARNING cinder.quota [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2021161482 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2021161482, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:13 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] Created reservations ['0c5374cd-dcc0-4f29-b59b-eb4043512ade', '34de6732-e10d-4a6f-8161-b75de7082fad', '76981ce7-1ba3-4b36-abd6-11f9fd29b01d', '658450c8-83fe-4f8f-8ceb-5f7467284304'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-80d79cff-ab45-4c25-ac98-6bc950a765dc req-514569c3-d465-4033-8fe9-1d95a526d2c2 tempest-AttachVolumeNegativeTest-959773852 None] Terminate volume connection completed successfully. Sep 29 11:59:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-80d79cff-ab45-4c25-ac98-6bc950a765dc req-514569c3-d465-4033-8fe9-1d95a526d2c2 tempest-AttachVolumeNegativeTest-959773852 None] Deleting attachment ab3c8e80-6428-4b18-9deb-9d68bf383811. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 11:59:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2ea0ba08-2152-4369-82d3-5fd366d782ec tempest-GroupSnapshotsTest-335565575 None] group_snapshot 739d6fe2-339b-4bc4-b26e-c78113fdb31f: deleted successfully Sep 29 11:59:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-34f6fe76-04ce-4168-aab8-471b6345d779" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-34f6fe76-04ce-4168-aab8-471b6345d779" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:14 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4389c98-f1a2-4d91-9b46-1e598598f57c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:14 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 Sep 29 11:59:14 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:15 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779" returned: 0 in 0.703s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:15 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779 Sep 29 11:59:15 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:15 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34f6fe76-04ce-4168-aab8-471b6345d779" returned: 0 in 0.407s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-34f6fe76-04ce-4168-aab8-471b6345d779" released by "delete_volume" :: held 1.261s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:15 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Created reservations ['97e410ce-cec5-4cb2-acf1-a1a9873e4d3d'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:15 devstack cinder-volume[86117]: WARNING cinder.db.api [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2021161482'] Sep 29 11:59:15 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Created reservations ['5fd0e787-dc04-49bd-9a24-3f9c8d2acc95', '48447c0d-002c-4e29-a2f1-2629dc3e8e65', 'a233b8c6-7b29-4781-a98c-27fa8c20cde3', 'dff2bc0f-07b8-42e8-bb6e-0fe334204ceb'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:16 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:59:16 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:16 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.424s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:16 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:59:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fa01c4f9-9421-47a2-9643-a1cc081ce82c tempest-GroupSnapshotsTest-335565575 None] Delete group completed successfully. Sep 29 11:59:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8cded6d7-f747-4fdb-8d75-76fd0285f304 tempest-GroupSnapshotsTest-335565575 None] Group tempest-GroupSnapshotsTest-Group-242029618: creating Sep 29 11:59:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8cded6d7-f747-4fdb-8d75-76fd0285f304 tempest-GroupSnapshotsTest-335565575 None] Group tempest-GroupSnapshotsTest-Group-242029618: created successfully Sep 29 11:59:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8cded6d7-f747-4fdb-8d75-76fd0285f304 tempest-GroupSnapshotsTest-335565575 None] Create group completed successfully. Sep 29 11:59:19 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (b42445ad-2f8b-4444-8b9d-4c02416474bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba67c227-f49e-4d4a-afde-efaa1afbf17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba67c227-f49e-4d4a-afde-efaa1afbf17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474859627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e8a350-befb-437b-9c2f-a8d4d6c37bf1,host='devstack@QuobyteHD#QuobyteHD',id=6c455f44-c292-4963-8205-a77177632a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:20Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ffc843-92f1-4f73-ab0d-8a3c07301546),volume_type_id=b2ffc843-92f1-4f73-ab0d-8a3c07301546)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c02596-8ad7-4e01-bf05-7a5929a62a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c02596-8ad7-4e01-bf05-7a5929a62a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab51f963-960c-4e8c-8c76-5b0ffa5f2633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab51f963-960c-4e8c-8c76-5b0ffa5f2633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c455f44-c292-4963-8205-a77177632a2b', 'volume_name': 'volume-6c455f44-c292-4963-8205-a77177632a2b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3af0f5-ed34-4257-b942-bd03afd877db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3af0f5-ed34-4257-b942-bd03afd877db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b90ec6-896f-4e4c-ac19-96b65a3819a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Volume 6c455f44-c292-4963-8205-a77177632a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c455f44-c292-4963-8205-a77177632a2b', 'volume_size': 1} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66e8a350-befb-437b-9c2f-a8d4d6c37bf1,created_at=2026-09-29T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474859627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e8a350-befb-437b-9c2f-a8d4d6c37bf1,host='devstack@QuobyteHD#QuobyteHD',id=6c455f44-c292-4963-8205-a77177632a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:20Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ffc843-92f1-4f73-ab0d-8a3c07301546),volume_type_id=b2ffc843-92f1-4f73-ab0d-8a3c07301546)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Creating volume 6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:59:20 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:20 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b 1073741824 Sep 29 11:59:20 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:20 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b 1073741824" returned: 0 in 0.661s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:20 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b Sep 29 11:59:20 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:21 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b" returned: 0 in 0.879s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:59:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b90ec6-896f-4e4c-ac19-96b65a3819a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c455f44-c292-4963-8205-a77177632a2b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6435f2f7-16f1-4fe4-a6d7-1f99dd7f9d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:21 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Volume volume-6c455f44-c292-4963-8205-a77177632a2b (6c455f44-c292-4963-8205-a77177632a2b): created successfully Sep 29 11:59:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6435f2f7-16f1-4fe4-a6d7-1f99dd7f9d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (b42445ad-2f8b-4444-8b9d-4c02416474bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bc802f07-20c1-4043-94aa-36cb2c0fdd3e tempest-GroupSnapshotsTest-335565575 None] Created volume successfully. Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (e30a90f2-2ac5-4947-a4cc-e101f9dc721b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7646a308-fe2c-4107-872c-df36845d235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7646a308-fe2c-4107-872c-df36845d235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779838139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e8a350-befb-437b-9c2f-a8d4d6c37bf1,host='devstack@QuobyteHD#QuobyteHD',id=e1f6cc35-bf18-4107-948e-7398cb244487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:24Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ffc843-92f1-4f73-ab0d-8a3c07301546),volume_type_id=b2ffc843-92f1-4f73-ab0d-8a3c07301546)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cd63ab-2801-4b1c-88da-af5edc42dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cd63ab-2801-4b1c-88da-af5edc42dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50a34e9-72db-4a0e-9e65-363acb37840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50a34e9-72db-4a0e-9e65-363acb37840d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f6cc35-bf18-4107-948e-7398cb244487', 'volume_name': 'volume-e1f6cc35-bf18-4107-948e-7398cb244487', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6392749-69d5-404a-978d-0b7c84322b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6392749-69d5-404a-978d-0b7c84322b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b57232d-fb2a-4d4d-9a80-fc797ac73989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:24 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Volume e1f6cc35-bf18-4107-948e-7398cb244487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f6cc35-bf18-4107-948e-7398cb244487', 'volume_size': 1} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66e8a350-befb-437b-9c2f-a8d4d6c37bf1,created_at=2026-09-29T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779838139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e8a350-befb-437b-9c2f-a8d4d6c37bf1,host='devstack@QuobyteHD#QuobyteHD',id=e1f6cc35-bf18-4107-948e-7398cb244487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:24Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ffc843-92f1-4f73-ab0d-8a3c07301546),volume_type_id=b2ffc843-92f1-4f73-ab0d-8a3c07301546)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Creating volume e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:59:24 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:59:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:24 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 1073741824 Sep 29 11:59:24 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:25 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 1073741824" returned: 0 in 0.597s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:25 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 Sep 29 11:59:25 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:25 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487" returned: 0 in 0.692s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b57232d-fb2a-4d4d-9a80-fc797ac73989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f6cc35-bf18-4107-948e-7398cb244487', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cb5f25-ef8e-43c0-8928-939b19458104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:25 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Volume volume-e1f6cc35-bf18-4107-948e-7398cb244487 (e1f6cc35-bf18-4107-948e-7398cb244487): created successfully Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cb5f25-ef8e-43c0-8928-939b19458104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (e30a90f2-2ac5-4947-a4cc-e101f9dc721b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f4fc7c49-e0b9-4619-8b2f-aaa1ee4917ce tempest-GroupSnapshotsTest-335565575 None] Created volume successfully. Sep 29 11:59:27 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0097ff15-eb15-4561-b343-f16948eb9d1e tempest-GroupSnapshotsTest-335565575 None] Update group completed successfully. Sep 29 11:59:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2a9c8020-97e3-4a42-a728-1359749ee47e tempest-GroupSnapshotsTest-335565575 None] Update group completed successfully. Sep 29 11:59:30 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-43cc4bb3-797b-4719-a194-b89df120a0bd tempest-GroupSnapshotsTest-335565575 None] Update group completed successfully. Sep 29 11:59:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ae1f5d0e-662d-4574-93d0-3344b7899e9a tempest-GroupSnapshotsTest-335565575 None] Update group completed successfully. Sep 29 11:59:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] GroupSnapshot 75c10f2f-d98b-4eaf-a9ed-c2c649fd746e: creating. Sep 29 11:59:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Group snapshot 75c10f2f-d98b-4eaf-a9ed-c2c649fd746e: creating. {{(pid=86117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 11:59:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Creating offline snapshot 4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 of volume 6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 11:59:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc91c0-9487-489a-aeb3-6a521882abc1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:34 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b Sep 29 11:59:34 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:35 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b" returned: 0 in 0.645s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:35 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 1G Sep 29 11:59:35 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:35 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 1G" returned: 0 in 0.469s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c455f44-c292-4963-8205-a77177632a2b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:35 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c455f44-c292-4963-8205-a77177632a2b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 Sep 29 11:59:35 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:36 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c455f44-c292-4963-8205-a77177632a2b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" returned: 0 in 0.351s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:36 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:59:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:36 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 Sep 29 11:59:36 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:36 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:36 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.info Sep 29 11:59:36 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:36 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.info" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:36 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:59:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:36 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.info Sep 29 11:59:36 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:37 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.info" returned: 0 in 0.333s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Creating offline snapshot deea6b30-f449-490b-9356-dff26be8bfcb of volume e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12527aa-f230-4f3b-96a9-2cac37063697]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:37 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 Sep 29 11:59:37 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:37 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487" returned: 0 in 0.430s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:37 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb 1G Sep 29 11:59:37 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:38 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb 1G" returned: 0 in 0.500s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f6cc35-bf18-4107-948e-7398cb244487 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:38 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f6cc35-bf18-4107-948e-7398cb244487 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb Sep 29 11:59:38 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:38 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f6cc35-bf18-4107-948e-7398cb244487 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb" returned: 0 in 0.395s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:38 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:59:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:38 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb Sep 29 11:59:38 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:38 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb" returned: 0 in 0.297s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:38 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.info Sep 29 11:59:38 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:39 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.info" returned: 0 in 0.306s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:39 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:59:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:39 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.info Sep 29 11:59:39 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:39 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.info" returned: 0 in 0.401s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bceebed0-9673-4589-b670-be1c10935b2a tempest-GroupSnapshotsTest-335565575 None] group_snapshot 75c10f2f-d98b-4eaf-a9ed-c2c649fd746e: created successfully Sep 29 11:59:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] group_snapshot 75c10f2f-d98b-4eaf-a9ed-c2c649fd746e: deleting Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] group_snapshot 75c10f2f-d98b-4eaf-a9ed-c2c649fd746e: deleting {{(pid=86117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-6c455f44-c292-4963-8205-a77177632a2b" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6c455f44-c292-4963-8205-a77177632a2b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Deleting offline snapshot 4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 of volume 6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] snapshot_file for this snap is: volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888910e-baa2-400c-aa9a-52ddff77d829]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:40 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 Sep 29 11:59:40 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:40 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" returned: 0 in 0.409s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c455f44-c292-4963-8205-a77177632a2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1036b5-d852-4d28-b691-235928e322a3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:40 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b Sep 29 11:59:40 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:41 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b" returned: 0 in 0.378s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:41 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 Sep 29 11:59:41 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:41 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" returned: 0 in 0.414s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:41 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9 Sep 29 11:59:41 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:41 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b.4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" returned: 0 in 0.248s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-4170e44c-97b0-45f9-9c4a-fd03fa9e61a9" released by "_delete_snapshot" :: held 1.586s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6c455f44-c292-4963-8205-a77177632a2b" released by "delete_snapshot" :: held 1.622s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-e1f6cc35-bf18-4107-948e-7398cb244487" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-e1f6cc35-bf18-4107-948e-7398cb244487" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-deea6b30-f449-490b-9356-dff26be8bfcb" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-deea6b30-f449-490b-9356-dff26be8bfcb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Deleting offline snapshot deea6b30-f449-490b-9356-dff26be8bfcb of volume e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] snapshot_file for this snap is: volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5e9f09-fe1f-402d-b9b8-9dddd08cbc38]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:42 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb Sep 29 11:59:42 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:42 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb" returned: 0 in 0.398s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f6cc35-bf18-4107-948e-7398cb244487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee34a3a1-20d7-434f-9a69-3c2fd9efcf03]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:42 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 Sep 29 11:59:42 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:42 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:42 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb Sep 29 11:59:42 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:43 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb" returned: 0 in 0.365s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:43 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb Sep 29 11:59:43 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:43 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487.deea6b30-f449-490b-9356-dff26be8bfcb" returned: 0 in 0.261s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-deea6b30-f449-490b-9356-dff26be8bfcb" released by "_delete_snapshot" :: held 1.503s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-e1f6cc35-bf18-4107-948e-7398cb244487" released by "delete_snapshot" :: held 1.531s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:43 devstack cinder-volume[86117]: WARNING cinder.quota [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1014280409 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1014280409, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:43 devstack cinder-volume[86117]: WARNING cinder.quota [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1014280409 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1014280409, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Created reservations ['bac26cdb-b2af-4be9-b3af-b5f13b0246a7', '3dc8a0be-91c4-4ce3-bf7a-654d200e82e5', '936a27fe-91b3-45dd-ada9-6efbbe813966', '847cd357-b437-42f8-bcb6-833a7a6d1842'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] Created reservations ['99fcd221-9d21-40be-a022-e2f22154e6e9', '07534f36-c655-44eb-8561-3ce5028879a1', '4cffedf7-b8de-4c2c-a5ce-3569f18cb3d4', 'fa5c50d7-6282-4f2f-b4a3-07d6172feadf'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-648f1c97-21a1-4d75-a471-3e181dc2dbdd tempest-GroupSnapshotsTest-335565575 None] group_snapshot 75c10f2f-d98b-4eaf-a9ed-c2c649fd746e: deleted successfully Sep 29 11:59:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-6c455f44-c292-4963-8205-a77177632a2b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6c455f44-c292-4963-8205-a77177632a2b" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[283f2fb9-fc88-4d1f-af2e-bc210cc475cb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:45 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b Sep 29 11:59:45 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:46 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b" returned: 0 in 0.533s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:46 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b Sep 29 11:59:46 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:46 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6c455f44-c292-4963-8205-a77177632a2b" returned: 0 in 0.330s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-6c455f44-c292-4963-8205-a77177632a2b" released by "delete_volume" :: held 0.948s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-e1f6cc35-bf18-4107-948e-7398cb244487" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-e1f6cc35-bf18-4107-948e-7398cb244487" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd4c709-c851-47ef-afb5-f60560d37410]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:46 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 Sep 29 11:59:46 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:47 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487" returned: 0 in 0.619s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:47 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487 Sep 29 11:59:47 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:47 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1f6cc35-bf18-4107-948e-7398cb244487" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-e1f6cc35-bf18-4107-948e-7398cb244487" released by "delete_volume" :: held 1.086s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Created reservations ['60f2e57c-9a83-474b-9fe3-c27b62bbb7bd'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:47 devstack cinder-volume[86117]: WARNING cinder.quota [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1014280409 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1014280409, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Created reservations ['0ffdfe4a-179f-4679-9e36-d9900b75a7c0', 'b048b55c-c55b-4062-8ce3-9725fa1066c5', '4da7985f-10e0-463d-906d-8bb7b891d1b5', 'e6d8368e-3d1f-4c73-9f44-2de9057f4b4a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Acquiring lock "cinder-ddabf7ae-1800-41b4-947d-2766678522f2-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "cinder-ddabf7ae-1800-41b4-947d-2766678522f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Acquiring lock "cinder-quobyte-ddabf7ae-1800-41b4-947d-2766678522f2" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:47 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Created reservations ['ddbeca40-2283-481d-b3ac-499dee499c4d', 'e5ca0aa4-bf06-40f5-9c0f-1c868387f511', '675f7175-2518-4257-a852-49a5967b08b0', 'fe31291a-e1ba-4a7c-a82d-1516823705a5'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "cinder-quobyte-ddabf7ae-1800-41b4-947d-2766678522f2" acquired by "delete_volume" :: waited 0.047s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a44f05-cf45-4df9-8a5b-5ff4a320de1e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:48 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 Sep 29 11:59:48 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:48 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:59:48 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:48 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2" returned: 0 in 0.534s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:48 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2 Sep 29 11:59:48 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:48 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.382s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:59:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-37433714-3472-4e0d-b2fb-86e0a7b1050f tempest-GroupSnapshotsTest-335565575 None] Delete group completed successfully. Sep 29 11:59:48 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ddabf7ae-1800-41b4-947d-2766678522f2" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "cinder-quobyte-ddabf7ae-1800-41b4-947d-2766678522f2" released by "delete_volume" :: held 0.873s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:48 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Created reservations ['6052029f-3f3b-4fbe-8fc9-bc2bff78c073', '7e64cbba-a695-4336-95e7-30d803731d2c', '15f1d8f8-ceeb-4e93-9cf8-64844298406f', 'a9c6cb9e-c943-4154-9b5f-10365dd77089'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:49 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 11:59:49 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:49 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.280s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 11:59:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Deleted volume successfully. Sep 29 11:59:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e314371-76a1-45b9-b683-dfbaf7f2b25d tempest-AttachVolumeShelveTestJSON-125540134 None] Lock "cinder-ddabf7ae-1800-41b4-947d-2766678522f2-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-140cc3cc-90be-45b5-a101-03f869bfe85e tempest-GroupSnapshotsTest-335565575 None] Group tempest-GroupSnapshotsTest-Group-452439508: creating Sep 29 11:59:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-140cc3cc-90be-45b5-a101-03f869bfe85e tempest-GroupSnapshotsTest-335565575 None] Group tempest-GroupSnapshotsTest-Group-452439508: created successfully Sep 29 11:59:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-140cc3cc-90be-45b5-a101-03f869bfe85e tempest-GroupSnapshotsTest-335565575 None] Create group completed successfully. Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Flow 'volume_create_manager' (c3766f1b-cb86-422c-9ac6-e1f12d56c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b3fbb9-aff1-4467-bf1b-b6cd60a8fdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b3fbb9-aff1-4467-bf1b-b6cd60a8fdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-933094598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93731b68-a56f-40bb-9bb5-a278f0e06da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b9ed949df426bb1e08b46253ad750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:51Z,use_quota=True,user_id='3e78b6634d6047ae908b1c4fbee30849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81eaaaa6-7746-4be8-a1d3-feb5d02006ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81eaaaa6-7746-4be8-a1d3-feb5d02006ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1038a0-b198-4efb-af5f-ae04b891a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1038a0-b198-4efb-af5f-ae04b891a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93731b68-a56f-40bb-9bb5-a278f0e06da9', 'volume_name': 'volume-93731b68-a56f-40bb-9bb5-a278f0e06da9', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46521e3-1fe2-4f95-9a6b-e303f1114fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46521e3-1fe2-4f95-9a6b-e303f1114fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19b9a80-4c32-42ef-a335-87b272ff25d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Volume 93731b68-a56f-40bb-9bb5-a278f0e06da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93731b68-a56f-40bb-9bb5-a278f0e06da9', 'volume_size': 1} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-933094598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93731b68-a56f-40bb-9bb5-a278f0e06da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b9ed949df426bb1e08b46253ad750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:51Z,use_quota=True,user_id='3e78b6634d6047ae908b1c4fbee30849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Creating volume 93731b68-a56f-40bb-9bb5-a278f0e06da9 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:59:50 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:59:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:50 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 1073741824 Sep 29 11:59:50 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:51 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 1073741824" returned: 0 in 0.572s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:51 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 Sep 29 11:59:51 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:51 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9" returned: 0 in 0.276s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19b9a80-4c32-42ef-a335-87b272ff25d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93731b68-a56f-40bb-9bb5-a278f0e06da9', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fedd50a-9127-4e55-b318-ba9ed3e53d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Volume volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 (93731b68-a56f-40bb-9bb5-a278f0e06da9): created successfully Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fedd50a-9127-4e55-b318-ba9ed3e53d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Flow 'volume_create_manager' (c3766f1b-cb86-422c-9ac6-e1f12d56c070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (172cec87-7256-41a8-b554-4f7f5b65dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b246f7-8585-4b9b-9eca-a1189dc99424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b246f7-8585-4b9b-9eca-a1189dc99424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-993100092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f6a4424-e828-4065-a16b-cc27185bc605,host='devstack@QuobyteHD#QuobyteHD',id=42f506ac-9a63-46df-8e34-297bf569b475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:52Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f7a4262-2a96-4ca4-a9e8-59b5a2e7a16e),volume_type_id=5f7a4262-2a96-4ca4-a9e8-59b5a2e7a16e)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a0e5cc-bcc5-4d45-9d02-85f9ce817a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a0e5cc-bcc5-4d45-9d02-85f9ce817a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b56b868-ed1a-40d4-82e8-e94875f99f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b56b868-ed1a-40d4-82e8-e94875f99f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f506ac-9a63-46df-8e34-297bf569b475', 'volume_name': 'volume-42f506ac-9a63-46df-8e34-297bf569b475', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bdd99a-51bd-468d-8eaf-4a85e104a744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bdd99a-51bd-468d-8eaf-4a85e104a744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ee72e5-b322-4ff1-9bcd-6cd4ff1480cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Volume 42f506ac-9a63-46df-8e34-297bf569b475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f506ac-9a63-46df-8e34-297bf569b475', 'volume_size': 1} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f6a4424-e828-4065-a16b-cc27185bc605,created_at=2026-09-29T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-993100092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f6a4424-e828-4065-a16b-cc27185bc605,host='devstack@QuobyteHD#QuobyteHD',id=42f506ac-9a63-46df-8e34-297bf569b475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db550ac1ae21424ea101b2777e25b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:52Z,use_quota=True,user_id='672c2c15594847a7a06da2f456c5506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f7a4262-2a96-4ca4-a9e8-59b5a2e7a16e),volume_type_id=5f7a4262-2a96-4ca4-a9e8-59b5a2e7a16e)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Creating volume 42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:59:51 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:59:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a178285e-a237-4a57-8655-1937d74e9428 tempest-AttachVolumeTestJSON-1539224374 None] Created volume successfully. Sep 29 11:59:51 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 1073741824 Sep 29 11:59:51 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:52 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 1073741824" returned: 0 in 0.540s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:52 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 Sep 29 11:59:52 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:52 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ee72e5-b322-4ff1-9bcd-6cd4ff1480cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f506ac-9a63-46df-8e34-297bf569b475', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec486f6-73d2-4302-ad11-fe171221b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Volume volume-42f506ac-9a63-46df-8e34-297bf569b475 (42f506ac-9a63-46df-8e34-297bf569b475): created successfully Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec486f6-73d2-4302-ad11-fe171221b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Flow 'volume_create_manager' (172cec87-7256-41a8-b554-4f7f5b65dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:52 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-75d755fa-167e-4459-8329-c5933a2707e5 tempest-GroupSnapshotsTest-335565575 None] Created volume successfully. Sep 29 11:59:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] GroupSnapshot bcf0eb72-a7b4-4389-a9f8-bf6ee06adc2e: creating. Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Group snapshot bcf0eb72-a7b4-4389-a9f8-bf6ee06adc2e: creating. {{(pid=86117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Creating offline snapshot f3777f22-5177-43f9-8983-0b5bba9bb526 of volume 42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bb3ede-55cd-40a0-a87c-e22e1eaf98f9]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:53 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 Sep 29 11:59:53 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-f4809f7f-a8b7-4858-a965-48d8ff81a24f req-b7249350-e549-4298-ac70-ecd3ca8891ab tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:53 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475" returned: 0 in 0.391s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:53 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 1G Sep 29 11:59:53 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:54 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 1G" returned: 0 in 0.435s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f506ac-9a63-46df-8e34-297bf569b475 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:54 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f506ac-9a63-46df-8e34-297bf569b475 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 Sep 29 11:59:54 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:54 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f506ac-9a63-46df-8e34-297bf569b475 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526" returned: 0 in 0.393s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:54 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:59:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:54 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 Sep 29 11:59:54 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:54 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526" returned: 0 in 0.265s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:54 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.info Sep 29 11:59:54 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:55 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.info" returned: 0 in 0.302s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:55 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 11:59:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:55 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.info Sep 29 11:59:55 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:55 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.info" returned: 0 in 0.269s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-f4809f7f-a8b7-4858-a965-48d8ff81a24f req-b7249350-e549-4298-ac70-ecd3ca8891ab tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.772s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-f4809f7f-a8b7-4858-a965-48d8ff81a24f req-b7249350-e549-4298-ac70-ecd3ca8891ab tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-f4809f7f-a8b7-4858-a965-48d8ff81a24f req-b7249350-e549-4298-ac70-ecd3ca8891ab tempest-AttachVolumeTestJSON-1539224374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-93731b68-a56f-40bb-9bb5-a278f0e06da9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5ee8636-d39e-4662-b3ef-f79d2b62e473', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 11:59:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-73506b6f-993b-4607-9a54-bbaef4fded8c tempest-GroupSnapshotsTest-335565575 None] group_snapshot bcf0eb72-a7b4-4389-a9f8-bf6ee06adc2e: created successfully Sep 29 11:59:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-f4809f7f-a8b7-4858-a965-48d8ff81a24f req-b7249350-e549-4298-ac70-ecd3ca8891ab tempest-AttachVolumeTestJSON-1539224374 None] attachment_update completed successfully. Sep 29 11:59:56 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] group_snapshot bcf0eb72-a7b4-4389-a9f8-bf6ee06adc2e: deleting Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] group_snapshot bcf0eb72-a7b4-4389-a9f8-bf6ee06adc2e: deleting {{(pid=86117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-42f506ac-9a63-46df-8e34-297bf569b475" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-42f506ac-9a63-46df-8e34-297bf569b475" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-f3777f22-5177-43f9-8983-0b5bba9bb526" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-f3777f22-5177-43f9-8983-0b5bba9bb526" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Deleting offline snapshot f3777f22-5177-43f9-8983-0b5bba9bb526 of volume 42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] snapshot_file for this snap is: volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaa8c3c-759b-45d8-a0ff-a50441ac80d2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:57 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 Sep 29 11:59:57 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:57 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526" returned: 0 in 0.471s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42f506ac-9a63-46df-8e34-297bf569b475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896d2cc-e6ed-457c-9653-2cdb196dcd96]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:57 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 Sep 29 11:59:57 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Flow 'volume_create_manager' (a1d58ef4-8fe8-49b0-bca4-4e7026f8f1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d29ab5-6574-433e-9f52-bff9339a072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d29ab5-6574-433e-9f52-bff9339a072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-748952479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe638bc-ff83-4bb9-b20f-e516efba0c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b9ed949df426bb1e08b46253ad750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:58Z,use_quota=True,user_id='3e78b6634d6047ae908b1c4fbee30849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6457138e-a7c8-430a-95ef-aca586f6b16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6457138e-a7c8-430a-95ef-aca586f6b16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08075ee3-9fc2-4acc-9f7a-b08e09b1d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08075ee3-9fc2-4acc-9f7a-b08e09b1d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe638bc-ff83-4bb9-b20f-e516efba0c97', 'volume_name': 'volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba0fdee-5aa7-463f-8bfe-ebd5780c0437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba0fdee-5aa7-463f-8bfe-ebd5780c0437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea670925-f53c-42f2-8f66-6b14c8ac15a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Volume cbe638bc-ff83-4bb9-b20f-e516efba0c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97', 'volume_size': 1} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-748952479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe638bc-ff83-4bb9-b20f-e516efba0c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b9ed949df426bb1e08b46253ad750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T09:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T09:59:58Z,use_quota=True,user_id='3e78b6634d6047ae908b1c4fbee30849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Creating volume cbe638bc-ff83-4bb9-b20f-e516efba0c97 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:59:57 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:59:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:57 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 1073741824 Sep 29 11:59:57 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:58 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475" returned: 0 in 0.544s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:58 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 Sep 29 11:59:58 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:58 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 1073741824" returned: 0 in 0.593s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:58 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526" returned: 0 in 0.500s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:58 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526 Sep 29 11:59:58 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:58 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 Sep 29 11:59:58 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:58 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97" returned: 0 in 0.283s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 11:59:58 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475.f3777f22-5177-43f9-8983-0b5bba9bb526" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea670925-f53c-42f2-8f66-6b14c8ac15a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cef498f-83f3-4048-a4fb-4cb1d1a57108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-f3777f22-5177-43f9-8983-0b5bba9bb526" released by "_delete_snapshot" :: held 2.027s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-42f506ac-9a63-46df-8e34-297bf569b475" released by "delete_snapshot" :: held 2.059s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 11:59:58 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Volume volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 (cbe638bc-ff83-4bb9-b20f-e516efba0c97): created successfully Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cef498f-83f3-4048-a4fb-4cb1d1a57108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Flow 'volume_create_manager' (a1d58ef4-8fe8-49b0-bca4-4e7026f8f1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-13db6401-f01b-4604-a516-49ab4b8e4627 tempest-AttachVolumeTestJSON-1539224374 None] Created volume successfully. Sep 29 11:59:58 devstack cinder-volume[86117]: WARNING cinder.quota [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2084617141 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2084617141, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:58 devstack cinder-volume[86117]: WARNING cinder.quota [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2084617141 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2084617141, it is now deprecated. Please use the default quota class for default quota. Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] Created reservations ['b6737c4f-d0a9-4de3-84cd-9f9b7d2ca61c', 'fa269114-0694-46be-bd60-5a6d57783a6f', '7c20f3cb-8e65-4b18-bee5-8bb3c5ac0f8a', 'd11ade87-3948-4d14-9972-abc2f2b082f6'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 11:59:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b7d28094-e662-4d80-87e7-3bd556c66e2a tempest-GroupSnapshotsTest-335565575 None] group_snapshot bcf0eb72-a7b4-4389-a9f8-bf6ee06adc2e: deleted successfully Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Flow 'volume_create_manager' (8a576516-4cf3-4029-8e99-ab94ff11c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7cae11-69ba-4a7d-9e29-171b06d3e6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7cae11-69ba-4a7d-9e29-171b06d3e6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1685902027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507fcb3c-5036-4aa2-b34d-506050579191,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8233b305642843e0ba8b38be5cf7e81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:00Z,use_quota=True,user_id='8032c9736fb04ae7baf14346b13d4f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcadc0d-a6bd-411c-ab23-fd00b534dc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcadc0d-a6bd-411c-ab23-fd00b534dc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3c9bf3-f9bc-4d35-b2fc-d2690de10656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3c9bf3-f9bc-4d35-b2fc-d2690de10656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507fcb3c-5036-4aa2-b34d-506050579191', 'volume_name': 'volume-507fcb3c-5036-4aa2-b34d-506050579191', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f8e35-771c-4e20-bbd0-570cb0f9da57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f8e35-771c-4e20-bbd0-570cb0f9da57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eeb69a-57f8-4f03-86e7-2cf31550ea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 11:59:59 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Volume 507fcb3c-5036-4aa2-b34d-506050579191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507fcb3c-5036-4aa2-b34d-506050579191', 'volume_size': 1} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T09:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1685902027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507fcb3c-5036-4aa2-b34d-506050579191,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8233b305642843e0ba8b38be5cf7e81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:00Z,use_quota=True,user_id='8032c9736fb04ae7baf14346b13d4f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Creating volume 507fcb3c-5036-4aa2-b34d-506050579191 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 11:59:59 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "cinder-quobyte-42f506ac-9a63-46df-8e34-297bf569b475" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 11:59:59 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 1073741824 Sep 29 11:59:59 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-42f506ac-9a63-46df-8e34-297bf569b475" acquired by "delete_volume" :: waited 0.033s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9948d4d-f70e-4644-bc4b-d4c08dd43128]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 11:59:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:00 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 Sep 29 12:00:00 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Flow 'volume_create_manager' (6c5ebe3c-df9f-4d46-80bf-e4380eac1b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a0b536-56fc-4047-bafa-830cd4c7c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:00 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475" returned: 0 in 0.521s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a0b536-56fc-4047-bafa-830cd4c7c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-230289235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e622ae2f1f2548c8a325ed4ecf6d17fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:00Z,use_quota=True,user_id='ba7012f512384a5ab13b4112dd698d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:00 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475 Sep 29 12:00:00 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d28f85f-5887-4ac9-bccf-f5344d1f1bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d28f85f-5887-4ac9-bccf-f5344d1f1bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a81a750-a64e-47c5-99c3-418d3a609a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a81a750-a64e-47c5-99c3-418d3a609a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e', 'volume_name': 'volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:00 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729377dd-3334-44bb-8d9b-5d6ff85320cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729377dd-3334-44bb-8d9b-5d6ff85320cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df3901a-5a2b-41f2-ac77-2c3c1ce50655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Volume c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e', 'volume_size': 1} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 1073741824" returned: 0 in 0.720s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:00 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 Sep 29 12:00:00 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:00 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42f506ac-9a63-46df-8e34-297bf569b475" returned: 0 in 0.301s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Lock "cinder-quobyte-42f506ac-9a63-46df-8e34-297bf569b475" released by "delete_volume" :: held 0.928s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:00 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191" returned: 0 in 0.282s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-230289235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e622ae2f1f2548c8a325ed4ecf6d17fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:00Z,use_quota=True,user_id='ba7012f512384a5ab13b4112dd698d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Creating volume c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:00 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Created reservations ['ce2531f7-cec5-44e8-ac4b-5d6de3ecb1fb'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:00 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e 1073741824 Sep 29 12:00:00 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eeb69a-57f8-4f03-86e7-2cf31550ea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507fcb3c-5036-4aa2-b34d-506050579191', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834c950f-cb7a-44bf-9403-7ef96d4a6809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Volume volume-507fcb3c-5036-4aa2-b34d-506050579191 (507fcb3c-5036-4aa2-b34d-506050579191): created successfully Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834c950f-cb7a-44bf-9403-7ef96d4a6809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Flow 'volume_create_manager' (8a576516-4cf3-4029-8e99-ab94ff11c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-151897d5-6a64-4aed-9271-04504f28bd2d req-637440d0-d3d0-4962-93af-c581d14ac996 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-5065c1e4-bb91-4412-a5ef-b525caa272a9 req-1f1052a7-5912-4e2b-aa5d-9bad412b1eb4 tempest-VolumesGetTestJSON-1146384039 None] Created volume successfully. Sep 29 12:00:00 devstack cinder-volume[86117]: WARNING cinder.quota [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2084617141 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2084617141, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Created reservations ['c781343b-ff81-4ab8-bd3c-6ca698571ac9', 'c6dcfd8f-8292-4043-8073-6474f0088376', '9d551979-ea3a-40fd-9d70-517fef5c0493', '957f3153-de0d-4052-b903-1b2f796d99a6'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:01 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:01 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:01 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e 1073741824" returned: 0 in 0.525s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:01 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.308s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6aa40016-b4b2-4757-b436-aa2b1e7ba4a5 tempest-GroupSnapshotsTest-335565575 None] Delete group completed successfully. Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:01 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e Sep 29 12:00:01 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:01 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e" returned: 0 in 0.239s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-151897d5-6a64-4aed-9271-04504f28bd2d req-637440d0-d3d0-4962-93af-c581d14ac996 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.729s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-151897d5-6a64-4aed-9271-04504f28bd2d req-637440d0-d3d0-4962-93af-c581d14ac996 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df3901a-5a2b-41f2-ac77-2c3c1ce50655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59c0be2-3ada-4c6b-8347-ea1c7bd61ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:01 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Volume volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e (c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e): created successfully Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59c0be2-3ada-4c6b-8347-ea1c7bd61ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Flow 'volume_create_manager' (6c5ebe3c-df9f-4d46-80bf-e4380eac1b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-151897d5-6a64-4aed-9271-04504f28bd2d req-637440d0-d3d0-4962-93af-c581d14ac996 tempest-AttachVolumeTestJSON-1539224374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5500956d-5a94-4635-a051-b9f72dcfffd8', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:00:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-41b46c66-4d6b-4f03-8439-3f50bc1234b9 tempest-AttachVolumeNegativeTest-959773852 None] Created volume successfully. Sep 29 12:00:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-151897d5-6a64-4aed-9271-04504f28bd2d req-637440d0-d3d0-4962-93af-c581d14ac996 tempest-AttachVolumeTestJSON-1539224374 None] attachment_update completed successfully. Sep 29 12:00:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Acquiring lock "cinder-507fcb3c-5036-4aa2-b34d-506050579191-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Lock "cinder-507fcb3c-5036-4aa2-b34d-506050579191-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Acquiring lock "cinder-quobyte-507fcb3c-5036-4aa2-b34d-506050579191" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Lock "cinder-quobyte-507fcb3c-5036-4aa2-b34d-506050579191" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdb3c62-fc3d-45e3-8f32-25fc12248e13]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:02 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 Sep 29 12:00:02 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:02 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191" returned: 0 in 0.502s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:02 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191 Sep 29 12:00:02 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:02 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-507fcb3c-5036-4aa2-b34d-506050579191" returned: 0 in 0.339s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Lock "cinder-quobyte-507fcb3c-5036-4aa2-b34d-506050579191" released by "delete_volume" :: held 0.903s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG cinder.quota [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Created reservations ['bf27cb60-37b7-47e2-b9f5-b101899dd9da', '843e638e-4961-41cf-b396-dff607d4643b', '4bb29dcd-f8fe-44e9-9932-a5191c4791b7', '598068e1-7451-45d6-8aa5-05e02b61ffcf'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:03 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:03 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6a697af0-031f-4714-94eb-d36f8d4a05b3 req-532a3832-b435-47a0-9999-4dc66f7b13ae tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6a697af0-031f-4714-94eb-d36f8d4a05b3 req-532a3832-b435-47a0-9999-4dc66f7b13ae tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6a697af0-031f-4714-94eb-d36f8d4a05b3 req-532a3832-b435-47a0-9999-4dc66f7b13ae tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-6a697af0-031f-4714-94eb-d36f8d4a05b3 req-532a3832-b435-47a0-9999-4dc66f7b13ae tempest-AttachVolumeNegativeTest-959773852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52f14c10-717d-4d6b-abb7-e803adcb95f3', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:00:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-6a697af0-031f-4714-94eb-d36f8d4a05b3 req-532a3832-b435-47a0-9999-4dc66f7b13ae tempest-AttachVolumeNegativeTest-959773852 None] attachment_update completed successfully. Sep 29 12:00:03 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG cinder.manager [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Deleted volume successfully. Sep 29 12:00:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-88814a96-9b41-4a25-8720-2eebd7d0464a req-6129c07f-67f2-4fc0-a258-21f25369d69f tempest-VolumesGetTestJSON-1146384039 None] Lock "cinder-507fcb3c-5036-4aa2-b34d-506050579191-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:04 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-a92fadd4-c459-4fa4-bb2b-70e1b6567db9 req-c7a5191c-5317-4bc6-a970-163be2688fc0 tempest-AttachVolumeTestJSON-1539224374 None] Terminate volume connection completed successfully. Sep 29 12:00:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-a92fadd4-c459-4fa4-bb2b-70e1b6567db9 req-c7a5191c-5317-4bc6-a970-163be2688fc0 tempest-AttachVolumeTestJSON-1539224374 None] Deleting attachment b5ee8636-d39e-4662-b3ef-f79d2b62e473. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:00:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=141,cinder:UPDATE=119,cinder:INSERT=31,cinder:DELETE=4 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:00:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=154,cinder:UPDATE=151,cinder:INSERT=29,cinder:DELETE=6 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:00:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-3403e837-8bf8-4453-8bcc-7cb254f27a89 req-8870f388-caf6-49c8-810b-83711addd7c5 tempest-AttachVolumeTestJSON-1539224374 None] Terminate volume connection completed successfully. Sep 29 12:00:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-3403e837-8bf8-4453-8bcc-7cb254f27a89 req-8870f388-caf6-49c8-810b-83711addd7c5 tempest-AttachVolumeTestJSON-1539224374 None] Deleting attachment 5500956d-5a94-4635-a051-b9f72dcfffd8. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:00:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-27cfecfe-ac6b-4115-8523-bbd837960292 req-ad1a2733-dd1d-45ee-9c8b-f69e90cf10da tempest-AttachVolumeNegativeTest-959773852 None] Terminate volume connection completed successfully. Sep 29 12:00:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-27cfecfe-ac6b-4115-8523-bbd837960292 req-ad1a2733-dd1d-45ee-9c8b-f69e90cf10da tempest-AttachVolumeNegativeTest-959773852 None] Deleting attachment 52f14c10-717d-4d6b-abb7-e803adcb95f3. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:12 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:12 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:12 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:00:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:00:14 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8b151883-6894-4390-89af-0c42caae360b tempest-GroupSnapshotsV319Test-569316013 None] Group tempest-GroupSnapshotsV319Test-Group-240901417: creating Sep 29 12:00:14 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8b151883-6894-4390-89af-0c42caae360b tempest-GroupSnapshotsV319Test-569316013 None] Group tempest-GroupSnapshotsV319Test-Group-240901417: created successfully Sep 29 12:00:14 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8b151883-6894-4390-89af-0c42caae360b tempest-GroupSnapshotsV319Test-569316013 None] Create group completed successfully. Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "cinder-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "cinder-cbe638bc-ff83-4bb9-b20f-e516efba0c97-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-cbe638bc-ff83-4bb9-b20f-e516efba0c97-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "cinder-quobyte-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "cinder-quobyte-cbe638bc-ff83-4bb9-b20f-e516efba0c97" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-quobyte-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-quobyte-cbe638bc-ff83-4bb9-b20f-e516efba0c97" acquired by "delete_volume" :: waited 0.054s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aba901-219e-4d83-a4b1-764f2afc4c17]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f422a957-af8b-47e1-8373-d09bc4430cfe]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:16 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e Sep 29 12:00:16 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:16 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 Sep 29 12:00:16 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:16 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:16 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97 Sep 29 12:00:16 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:16 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e" returned: 0 in 0.507s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:16 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e Sep 29 12:00:16 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:16 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cbe638bc-ff83-4bb9-b20f-e516efba0c97" returned: 0 in 0.312s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-quobyte-cbe638bc-ff83-4bb9-b20f-e516efba0c97" released by "delete_volume" :: held 0.821s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Flow 'volume_create_manager' (56c56a31-ed9c-4432-aac8-b23cec5f8169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569009f-8e08-4826-84cd-7b81584cf510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569009f-8e08-4826-84cd-7b81584cf510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202516625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d29754c-fb7f-4d31-a22e-c951d0fa3e1e,host='devstack@QuobyteHD#QuobyteHD',id=0185f510-e74d-44f9-b632-9ce5605e6fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c470b9b6e3b4667b2051a69ac5ca488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:17Z,use_quota=True,user_id='7a2daae7f3fa49dcb2822b51c7db6eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e92025e-62c8-463c-b73b-11cd2402347c),volume_type_id=9e92025e-62c8-463c-b73b-11cd2402347c)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd91f96c-0cde-4149-b882-3186d18273b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd91f96c-0cde-4149-b882-3186d18273b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:16 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0829a2c8-5366-4d7d-810b-9ab8cefc0be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0829a2c8-5366-4d7d-810b-9ab8cefc0be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0185f510-e74d-44f9-b632-9ce5605e6fb7', 'volume_name': 'volume-0185f510-e74d-44f9-b632-9ce5605e6fb7', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d84366-0d8d-45bd-badd-01fdce1739e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d84366-0d8d-45bd-badd-01fdce1739e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3760d682-6b26-45bc-a205-6810b96c0a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Volume 0185f510-e74d-44f9-b632-9ce5605e6fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0185f510-e74d-44f9-b632-9ce5605e6fb7', 'volume_size': 1} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d29754c-fb7f-4d31-a22e-c951d0fa3e1e,created_at=2026-09-29T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202516625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d29754c-fb7f-4d31-a22e-c951d0fa3e1e,host='devstack@QuobyteHD#QuobyteHD',id=0185f510-e74d-44f9-b632-9ce5605e6fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c470b9b6e3b4667b2051a69ac5ca488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:17Z,use_quota=True,user_id='7a2daae7f3fa49dcb2822b51c7db6eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e92025e-62c8-463c-b73b-11cd2402347c),volume_type_id=9e92025e-62c8-463c-b73b-11cd2402347c)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Creating volume 0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:16 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e" returned: 0 in 0.434s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:16 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 1073741824 Sep 29 12:00:16 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-quobyte-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e" released by "delete_volume" :: held 1.027s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:16 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Created reservations ['d1eac0d4-9654-487b-8e90-2ac76575c587', 'd8bcb97d-9e4f-4273-b8fa-b2e642666fc3', 'f6ac87a1-c9c4-4525-b9a1-a60cfa75f5bb', 'b68c7020-dc3a-4793-b114-bc61b7f764e7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Created reservations ['779b6dad-9bca-455e-8553-ab3adc0eb15f', '29d7274c-3317-4759-ad14-6131b4f68321', '92026b2b-e59c-40d6-ae88-3ea050efb5da', '17148f9c-6f6a-49de-bf2b-9522de10ebea'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:17 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:17 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:17 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:17 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:17 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.307s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Deleted volume successfully. Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4860f59b-1d65-4eb1-a9d9-f1372ffa89b4 tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-cbe638bc-ff83-4bb9-b20f-e516efba0c97-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:17 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 1073741824" returned: 0 in 0.606s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:17 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.356s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Deleted volume successfully. Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b93558f8-fbd3-448a-ae5d-281c85f84bc0 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-c846d4ee-216a-4d6b-8afe-3ab8d3a46a9e-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:17 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 Sep 29 12:00:17 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:17 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7" returned: 0 in 0.246s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3760d682-6b26-45bc-a205-6810b96c0a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0185f510-e74d-44f9-b632-9ce5605e6fb7', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfe5043-86b7-4de5-bb92-414a13f5e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Volume volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 (0185f510-e74d-44f9-b632-9ce5605e6fb7): created successfully Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfe5043-86b7-4de5-bb92-414a13f5e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Flow 'volume_create_manager' (56c56a31-ed9c-4432-aac8-b23cec5f8169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-59ccc389-3c80-44d0-9b19-257f1bc61356 tempest-GroupSnapshotsV319Test-569316013 None] Created volume successfully. Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "cinder-93731b68-a56f-40bb-9bb5-a278f0e06da9-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-93731b68-a56f-40bb-9bb5-a278f0e06da9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "cinder-quobyte-93731b68-a56f-40bb-9bb5-a278f0e06da9" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-quobyte-93731b68-a56f-40bb-9bb5-a278f0e06da9" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] GroupSnapshot 12f90c6a-6b52-4113-b870-0b533dfb894d: creating. Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6157e1-6fcc-40d7-8fbf-b74e7a5c9fc2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "cinder-9ab109ba-fd42-4a97-808b-497ce07b967e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-9ab109ba-fd42-4a97-808b-497ce07b967e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Group snapshot 12f90c6a-6b52-4113-b870-0b533dfb894d: creating. {{(pid=86117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:18 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 Sep 29 12:00:18 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Creating offline snapshot 29537bdf-35c1-42c9-97d9-96a2e875bd5a of volume 0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "cinder-quobyte-9ab109ba-fd42-4a97-808b-497ce07b967e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ac9fe6-4449-49d7-b3e7-c12fe7444a4c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-quobyte-9ab109ba-fd42-4a97-808b-497ce07b967e" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfc314f-a16c-4665-bef6-6ce19c94a0d0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:18 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 Sep 29 12:00:18 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:18 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e Sep 29 12:00:18 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:18 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9" returned: 0 in 0.443s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:18 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9 Sep 29 12:00:18 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:18 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7" returned: 0 in 0.440s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:18 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a 1G Sep 29 12:00:18 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:18 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e" returned: 0 in 0.449s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:19 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e Sep 29 12:00:19 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:19 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-93731b68-a56f-40bb-9bb5-a278f0e06da9" returned: 0 in 0.323s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-quobyte-93731b68-a56f-40bb-9bb5-a278f0e06da9" released by "delete_volume" :: held 0.837s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Created reservations ['bff790d1-dbbc-483d-aad7-bad1cef630bb', '6c74a348-b3e9-449c-a9ae-d8b78c2d46bb', '15a4712e-0e61-4a2b-b3fe-603a5a323177', '07bcd880-5afa-4280-90d3-7cd41bd526d3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:19 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:19 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:19 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9ab109ba-fd42-4a97-808b-497ce07b967e" returned: 0 in 0.318s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-quobyte-9ab109ba-fd42-4a97-808b-497ce07b967e" released by "delete_volume" :: held 0.838s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Created reservations ['87b00a77-1caa-487c-8cac-54263bfd9169', '462d65b8-fe94-4f75-bbd7-f0ef11b77d9f', 'ac94429d-dc9b-45f4-a3fc-938b01586af6', '3be444ab-4e6b-4f5c-8246-8d610dcc8d02'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:19 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a 1G" returned: 0 in 0.565s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:19 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:19 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:19 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:19 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:19 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.427s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Deleted volume successfully. Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "cinder-7f475312-7bdf-4d6d-8f6b-4149c600013c-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-24f22eed-0187-4738-8560-25893c97cf6a tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-93731b68-a56f-40bb-9bb5-a278f0e06da9-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-7f475312-7bdf-4d6d-8f6b-4149c600013c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "cinder-quobyte-7f475312-7bdf-4d6d-8f6b-4149c600013c" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-quobyte-7f475312-7bdf-4d6d-8f6b-4149c600013c" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7301c6-62f3-4e95-9c18-f4ad220247e6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:19 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a" returned: 0 in 0.464s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:19 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:19 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.420s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:19 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:19 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a Sep 29 12:00:19 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Deleted volume successfully. Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "cinder-77cdbd50-a27d-4307-9c25-fbdab415d7ea-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-77cdbd50-a27d-4307-9c25-fbdab415d7ea-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe05143f-ba2e-49ac-a0f6-1fb851b7ae50 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-9ab109ba-fd42-4a97-808b-497ce07b967e-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "cinder-quobyte-77cdbd50-a27d-4307-9c25-fbdab415d7ea" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:20 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-quobyte-77cdbd50-a27d-4307-9c25-fbdab415d7ea" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:20 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2242f18-dd05-4b47-bc36-2dea5fdb9591]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:20 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a" returned: 0 in 0.310s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:20 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.info Sep 29 12:00:20 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:20 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea Sep 29 12:00:20 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:20 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c" returned: 0 in 0.511s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:20 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c Sep 29 12:00:20 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:20 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.info" returned: 0 in 0.332s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:20 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:20 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea" returned: 0 in 0.482s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:20 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.info Sep 29 12:00:20 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:20 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea Sep 29 12:00:20 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:20 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f475312-7bdf-4d6d-8f6b-4149c600013c" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-quobyte-7f475312-7bdf-4d6d-8f6b-4149c600013c" released by "delete_volume" :: held 0.956s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:20 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Created reservations ['07be7e20-4266-43f0-b919-d0120af1c3e8', '3c7f7933-5ae5-4fa3-9529-a8a85b48bbfb', 'c8c403b9-cbde-4c69-8ee1-8c910ba01ffb', '73087d94-1b35-40c8-9c08-3a03b5f54f18'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:21 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.info" returned: 0 in 0.438s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:21 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-77cdbd50-a27d-4307-9c25-fbdab415d7ea" returned: 0 in 0.448s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-quobyte-77cdbd50-a27d-4307-9c25-fbdab415d7ea" released by "delete_volume" :: held 1.017s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:21 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:21 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8c69512d-9334-4eb2-9bde-b952af13c30d tempest-GroupSnapshotsV319Test-569316013 None] group_snapshot 12f90c6a-6b52-4113-b870-0b533dfb894d: created successfully Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Created reservations ['fc092f1a-587a-4d38-8b26-46300aa217ec', '7462163e-f577-4946-bbf2-1a4961c1c149', 'be76465a-e8b7-4e81-ad1c-8b6250e7fc91', 'bb2d12df-4cd4-4097-95fb-769bff8f7683'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:21 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:21 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:21 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.319s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Deleted volume successfully. Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d4f16c30-e3f3-473b-8c16-afc136d5f96d tempest-AttachVolumeTestJSON-1539224374 None] Lock "cinder-7f475312-7bdf-4d6d-8f6b-4149c600013c-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:21 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.283s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Deleted volume successfully. Sep 29 12:00:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2174ec7f-1dda-48f2-8042-538e0d6e1bc5 tempest-AttachVolumeNegativeTest-959773852 None] Lock "cinder-77cdbd50-a27d-4307-9c25-fbdab415d7ea-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] group_snapshot 12f90c6a-6b52-4113-b870-0b533dfb894d: deleting Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] group_snapshot 12f90c6a-6b52-4113-b870-0b533dfb894d: deleting {{(pid=86117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Acquiring lock "cinder-quobyte-0185f510-e74d-44f9-b632-9ce5605e6fb7" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Lock "cinder-quobyte-0185f510-e74d-44f9-b632-9ce5605e6fb7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Acquiring lock "cinder-quobyte-29537bdf-35c1-42c9-97d9-96a2e875bd5a" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Lock "cinder-quobyte-29537bdf-35c1-42c9-97d9-96a2e875bd5a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Deleting offline snapshot 29537bdf-35c1-42c9-97d9-96a2e875bd5a of volume 0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] snapshot_file for this snap is: volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a7acc9-11f6-4ebf-8ce9-8bb7a399058c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:22 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a Sep 29 12:00:22 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:22 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a" returned: 0 in 0.512s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0185f510-e74d-44f9-b632-9ce5605e6fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeff18e5-9a04-4c2f-a8e2-a041645fdcc3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:23 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 Sep 29 12:00:23 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:23 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7" returned: 0 in 0.493s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:23 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a Sep 29 12:00:23 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:23 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a" returned: 0 in 0.490s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:23 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a Sep 29 12:00:23 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:24 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7.29537bdf-35c1-42c9-97d9-96a2e875bd5a" returned: 0 in 0.282s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Lock "cinder-quobyte-29537bdf-35c1-42c9-97d9-96a2e875bd5a" released by "_delete_snapshot" :: held 1.970s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Lock "cinder-quobyte-0185f510-e74d-44f9-b632-9ce5605e6fb7" released by "delete_snapshot" :: held 2.003s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:24 devstack cinder-volume[86117]: WARNING cinder.quota [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1684389079 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1684389079, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:24 devstack cinder-volume[86117]: WARNING cinder.quota [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1684389079 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1684389079, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:24 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] Created reservations ['9f6e3076-131b-48b2-8a26-65f5ca4eb187', 'd27c2159-c813-4f93-b961-4513c968ab34', '64933ab3-e8ba-4144-a180-b7bef0ff8bd7', '748ce969-c380-4809-9497-d7243b8645c8'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:24 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f50d346d-b279-4f58-907c-2f1a53cdc3bf tempest-GroupSnapshotsV319Test-569316013 None] group_snapshot 12f90c6a-6b52-4113-b870-0b533dfb894d: deleted successfully Sep 29 12:00:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Acquiring lock "cinder-quobyte-0185f510-e74d-44f9-b632-9ce5605e6fb7" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Lock "cinder-quobyte-0185f510-e74d-44f9-b632-9ce5605e6fb7" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:25 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bced60-eae0-4875-9e15-685d1af5eb5d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:25 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 Sep 29 12:00:25 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:25 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7" returned: 0 in 0.464s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:25 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7 Sep 29 12:00:25 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:26 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0185f510-e74d-44f9-b632-9ce5605e6fb7" returned: 0 in 0.336s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Lock "cinder-quobyte-0185f510-e74d-44f9-b632-9ce5605e6fb7" released by "delete_volume" :: held 0.934s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Created reservations ['78d1c30c-eb0a-404d-8bd9-60edd28db645'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:26 devstack cinder-volume[86117]: WARNING cinder.quota [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1684389079 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1684389079, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Created reservations ['32a88198-38a3-4885-8e16-da0a6e2f9d02', '71a90937-00f7-4dcf-879b-6debe5656771', 'c9329760-03ef-4f36-9d6f-a544c28bd8a8', '85fff7fe-71e9-482d-becb-c53f7550bd9a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:26 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:26 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:26 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.287s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:27 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:27 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f8de321d-5274-4bea-afbf-6d597e795aa2 tempest-GroupSnapshotsV319Test-569316013 None] Delete group completed successfully. Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Flow 'volume_create_manager' (11601e48-c2b5-411d-9911-2e028bc483e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2699e600-325f-4eba-b7b9-c8ae0b67825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2699e600-325f-4eba-b7b9-c8ae0b67825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-621037938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bd2e17-be4d-4ebb-b452-07520dec209f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8004fccb426e4ffdb7c0deed168dcae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:34Z,use_quota=True,user_id='c29a2b97980d47a983b544803b083458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14110d83-418a-4494-a256-7d1b37de061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14110d83-418a-4494-a256-7d1b37de061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f4770b-e88d-4c30-937b-6c3ee6a30d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f4770b-e88d-4c30-937b-6c3ee6a30d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9bd2e17-be4d-4ebb-b452-07520dec209f', 'volume_name': 'volume-b9bd2e17-be4d-4ebb-b452-07520dec209f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2729a7c9-7685-4b6f-9550-8728b5fda7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2729a7c9-7685-4b6f-9550-8728b5fda7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8b094b-b6c5-46d0-9474-4b6946ddf73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:34 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Volume b9bd2e17-be4d-4ebb-b452-07520dec209f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9bd2e17-be4d-4ebb-b452-07520dec209f', 'volume_size': 1} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-621037938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bd2e17-be4d-4ebb-b452-07520dec209f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8004fccb426e4ffdb7c0deed168dcae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:34Z,use_quota=True,user_id='c29a2b97980d47a983b544803b083458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Creating volume b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:34 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:34 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f 1073741824 Sep 29 12:00:34 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d052b469-a39f-41da-b741-c1b5f7a361bc tempest-GroupsV314Test-47685642 None] Group tempest-GroupsV314Test-Group-1817571056: creating Sep 29 12:00:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d052b469-a39f-41da-b741-c1b5f7a361bc tempest-GroupsV314Test-47685642 None] Group tempest-GroupsV314Test-Group-1817571056: created successfully Sep 29 12:00:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d052b469-a39f-41da-b741-c1b5f7a361bc tempest-GroupsV314Test-47685642 None] Create group completed successfully. Sep 29 12:00:34 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f 1073741824" returned: 0 in 0.578s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:34 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f Sep 29 12:00:34 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:35 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f" returned: 0 in 0.262s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8b094b-b6c5-46d0-9474-4b6946ddf73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9bd2e17-be4d-4ebb-b452-07520dec209f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e5f74b-48f0-4173-8425-262a76feeace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:35 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Volume volume-b9bd2e17-be4d-4ebb-b452-07520dec209f (b9bd2e17-be4d-4ebb-b452-07520dec209f): created successfully Sep 29 12:00:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e5f74b-48f0-4173-8425-262a76feeace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Flow 'volume_create_manager' (11601e48-c2b5-411d-9911-2e028bc483e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-08b1668e-6046-4beb-b6fd-7f376d6f4608 req-f1899a91-bcd1-4bd3-a8f8-c678103c6df0 tempest-VolumesSnapshotsTestJSON-820956299 None] Created volume successfully. Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Flow 'volume_create_manager' (c6b5aae7-2e67-4748-aa89-01dc1c9356fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e319d4-e07d-4637-b794-0e37d2b37011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e319d4-e07d-4637-b794-0e37d2b37011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-225586064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b7a1c8-c860-4b32-96eb-9d96586c0da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9701b65e12534a45b2c00d50493687df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:36Z,use_quota=True,user_id='f5e6b667b7684b46908a915aba468598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d8fa2a1-0d4d-4571-8519-66725dadf55a),volume_type_id=5d8fa2a1-0d4d-4571-8519-66725dadf55a)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c932ea1-d0a2-40d3-98de-967b19ae4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c932ea1-d0a2-40d3-98de-967b19ae4e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9192d27d-61b7-4423-923f-30d64a2875f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9192d27d-61b7-4423-923f-30d64a2875f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b7a1c8-c860-4b32-96eb-9d96586c0da7', 'volume_name': 'volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c45331-bbfd-4ddc-8a69-59f9751a8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c45331-bbfd-4ddc-8a69-59f9751a8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea92d5e-3d79-4a68-9d4d-5c5c69f8e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Volume 92b7a1c8-c860-4b32-96eb-9d96586c0da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7', 'volume_size': 1} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-225586064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b7a1c8-c860-4b32-96eb-9d96586c0da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9701b65e12534a45b2c00d50493687df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:36Z,use_quota=True,user_id='f5e6b667b7684b46908a915aba468598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d8fa2a1-0d4d-4571-8519-66725dadf55a),volume_type_id=5d8fa2a1-0d4d-4571-8519-66725dadf55a)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Creating volume 92b7a1c8-c860-4b32-96eb-9d96586c0da7 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:36 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:36 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 1073741824 Sep 29 12:00:36 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Flow 'volume_create_manager' (0447ff3a-e170-40a8-a96f-4fea63e5b26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cdc836-46cd-477f-9953-75bee9cb6ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cdc836-46cd-477f-9953-75bee9cb6ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316195064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8681f2d-1cda-4e0e-ab9e-ee3267e288be,host='devstack@QuobyteHD#QuobyteHD',id=42759e5d-de80-4583-9eef-61826b77348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9894fa22b1341148f8c003dc453f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:36Z,use_quota=True,user_id='30d225ee535f434a96fcacbb8f546803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c80386-2574-4869-92a8-41ad47c9ca4a),volume_type_id=32c80386-2574-4869-92a8-41ad47c9ca4a)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67235c74-c46a-4e3b-a664-b88758817a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67235c74-c46a-4e3b-a664-b88758817a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366ad800-033c-4034-af5c-d43cdb11225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366ad800-033c-4034-af5c-d43cdb11225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42759e5d-de80-4583-9eef-61826b77348a', 'volume_name': 'volume-42759e5d-de80-4583-9eef-61826b77348a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee16eb4f-77aa-46ea-85f5-dace7aa74b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee16eb4f-77aa-46ea-85f5-dace7aa74b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d93723-bd5a-4978-9bc7-ffd55c9d8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:36 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Volume 42759e5d-de80-4583-9eef-61826b77348a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42759e5d-de80-4583-9eef-61826b77348a', 'volume_size': 1} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:36 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 1073741824" returned: 0 in 0.536s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:37 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 Sep 29 12:00:37 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:37 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7" returned: 0 in 0.254s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8681f2d-1cda-4e0e-ab9e-ee3267e288be,created_at=2026-09-29T10:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316195064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8681f2d-1cda-4e0e-ab9e-ee3267e288be,host='devstack@QuobyteHD#QuobyteHD',id=42759e5d-de80-4583-9eef-61826b77348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9894fa22b1341148f8c003dc453f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:36Z,use_quota=True,user_id='30d225ee535f434a96fcacbb8f546803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c80386-2574-4869-92a8-41ad47c9ca4a),volume_type_id=32c80386-2574-4869-92a8-41ad47c9ca4a)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Creating volume 42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:37 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea92d5e-3d79-4a68-9d4d-5c5c69f8e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:37 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a 1073741824 Sep 29 12:00:37 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d6a0d5-09e9-48cb-91d9-d8e9e6aea0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:37 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Volume volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 (92b7a1c8-c860-4b32-96eb-9d96586c0da7): created successfully Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d6a0d5-09e9-48cb-91d9-d8e9e6aea0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Flow 'volume_create_manager' (c6b5aae7-2e67-4748-aa89-01dc1c9356fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:37 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-70ccd5ea-f39c-45d8-8368-4bd613702a28 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Created volume successfully. Sep 29 12:00:37 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a 1073741824" returned: 0 in 0.457s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:37 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a Sep 29 12:00:37 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:37 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a" returned: 0 in 0.238s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.343s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d93723-bd5a-4978-9bc7-ffd55c9d8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42759e5d-de80-4583-9eef-61826b77348a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4091ad76-a9f5-4e31-9cdc-93f870e6a655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Creating offline snapshot 0e15bb74-c6f8-4b79-a804-d8561663ea89 of volume b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e16861-5d1d-4a48-a351-ad416f34e1dc]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:38 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Volume volume-42759e5d-de80-4583-9eef-61826b77348a (42759e5d-de80-4583-9eef-61826b77348a): created successfully Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4091ad76-a9f5-4e31-9cdc-93f870e6a655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Flow 'volume_create_manager' (0447ff3a-e170-40a8-a96f-4fea63e5b26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:38 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-aaf0ef9f-3a27-4840-b019-88699dd9f9bc tempest-GroupsV314Test-47685642 None] Created volume successfully. Sep 29 12:00:38 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f Sep 29 12:00:38 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:38 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f" returned: 0 in 0.451s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:38 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 1G Sep 29 12:00:38 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:38 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:38 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:39 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 1G" returned: 0 in 0.543s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9bd2e17-be4d-4ebb-b452-07520dec209f -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:39 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9bd2e17-be4d-4ebb-b452-07520dec209f -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 Sep 29 12:00:39 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:39 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.358s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-99b73954-baa1-433c-b1de-b230d1f5ebba tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Retype volume completed successfully. Sep 29 12:00:39 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9bd2e17-be4d-4ebb-b452-07520dec209f -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89" returned: 0 in 0.380s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:39 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 is being set with open permissions: ugo+rw Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:39 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 Sep 29 12:00:39 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:39 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89" returned: 0 in 0.284s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:39 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.info Sep 29 12:00:39 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Acquiring lock "cinder-92b7a1c8-c860-4b32-96eb-9d96586c0da7-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:40 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.info" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:40 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.info is being set with open permissions: ugo+rw Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "cinder-92b7a1c8-c860-4b32-96eb-9d96586c0da7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:40 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.info Sep 29 12:00:40 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Acquiring lock "cinder-quobyte-92b7a1c8-c860-4b32-96eb-9d96586c0da7" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "cinder-quobyte-92b7a1c8-c860-4b32-96eb-9d96586c0da7" acquired by "delete_volume" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f8220-0a3a-4ece-b6a7-c567c4143dda]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:40 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.info" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:40 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 Sep 29 12:00:40 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.789s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:40 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Cloning volume 42759e5d-de80-4583-9eef-61826b77348a to volume 804e19ac-5f3d-486d-8071-ab560b6a4f50 Sep 29 12:00:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-6297d9b1-8e5c-4b0a-8485-ad90b2adcf09 req-b3e94058-381d-47b7-88f2-4e2bde7727a8 tempest-VolumesSnapshotsTestJSON-820956299 None] Create snapshot completed successfully Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Creating offline snapshot 7f9bb0f9-d4d7-431f-9812-19a1c905864d of volume 42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee37987-06c9-4244-adb7-03a95e8062b0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:40 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a Sep 29 12:00:40 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:40 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7" returned: 0 in 0.420s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:40 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7 Sep 29 12:00:40 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:40 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a" returned: 0 in 0.389s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:40 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d 1G Sep 29 12:00:40 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:40 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-92b7a1c8-c860-4b32-96eb-9d96586c0da7" returned: 0 in 0.249s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "cinder-quobyte-92b7a1c8-c860-4b32-96eb-9d96586c0da7" released by "delete_volume" :: held 0.735s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:41 devstack cinder-volume[86117]: WARNING cinder.quota [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:41 devstack cinder-volume[86117]: WARNING cinder.quota [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Created reservations ['fcb3eafe-7940-4ffb-934b-53a86ba343b2', '18292fd5-318c-4da2-9c89-c6171daa0f76', 'cda01854-3cd4-4ef7-8091-e1f759c367f0', 'bfbebb4e-85ab-4d2f-aae5-40b0f9c02859'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:41 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:41 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "cinder-0e15bb74-c6f8-4b79-a804-d8561663ea89-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-0e15bb74-c6f8-4b79-a804-d8561663ea89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "cinder-quobyte-b9bd2e17-be4d-4ebb-b452-07520dec209f" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-quobyte-b9bd2e17-be4d-4ebb-b452-07520dec209f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "cinder-quobyte-0e15bb74-c6f8-4b79-a804-d8561663ea89" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-quobyte-0e15bb74-c6f8-4b79-a804-d8561663ea89" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Deleting offline snapshot 0e15bb74-c6f8-4b79-a804-d8561663ea89 of volume b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] snapshot_file for this snap is: volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1739cf4-644c-4c32-b44a-efacb3454bb2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:41 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.433s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:41 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Deleted volume successfully. Sep 29 12:00:41 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d 1G" returned: 0 in 0.670s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42759e5d-de80-4583-9eef-61826b77348a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5787bff6-f829-4eab-bc35-ce1a31192186 tempest-VolumeRetypeWithoutMigrationTest-1495259623 None] Lock "cinder-92b7a1c8-c860-4b32-96eb-9d96586c0da7-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:41 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42759e5d-de80-4583-9eef-61826b77348a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d Sep 29 12:00:41 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:41 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 Sep 29 12:00:41 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:41 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89" returned: 0 in 0.432s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9bd2e17-be4d-4ebb-b452-07520dec209f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:00:42 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42759e5d-de80-4583-9eef-61826b77348a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d" returned: 0 in 0.398s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:42 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[973697ee-565e-46ea-9dd6-ae39516dead6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:42 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d Sep 29 12:00:42 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:42 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f Sep 29 12:00:42 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:42 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d" returned: 0 in 0.321s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:42 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.info Sep 29 12:00:42 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:42 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f" returned: 0 in 0.511s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:42 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 Sep 29 12:00:42 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:42 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.info" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:42 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:42 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.info Sep 29 12:00:42 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:42 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89" returned: 0 in 0.398s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:43 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89 Sep 29 12:00:43 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:43 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.info" returned: 0 in 0.344s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Acquiring lock "cinder-quobyte-804e19ac-5f3d-486d-8071-ab560b6a4f50" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-804e19ac-5f3d-486d-8071-ab560b6a4f50" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] snapshot: 7f9bb0f9-d4d7-431f-9812-19a1c905864d, volume: 804e19ac-5f3d-486d-8071-ab560b6a4f50, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd13e6-0175-435e-ae1b-6bc107ba3776]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:43 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f.0e15bb74-c6f8-4b79-a804-d8561663ea89" returned: 0 in 0.346s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:43 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d Sep 29 12:00:43 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-quobyte-0e15bb74-c6f8-4b79-a804-d8561663ea89" released by "_delete_snapshot" :: held 1.879s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-quobyte-b9bd2e17-be4d-4ebb-b452-07520dec209f" released by "delete_snapshot" :: held 1.912s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:43 devstack cinder-volume[86117]: WARNING cinder.quota [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.quota [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Created reservations ['f3e8b6ae-9d53-41ab-bc94-0dc21144597c', '23275f61-d06a-4a93-b92f-4724e125e295', '43b8c377-c727-47ad-a0b0-9078d84a18e3', '18e3fe41-a114-4678-abb1-7034aac5aaa7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Delete snapshot completed successfully. Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-7b2ae9e7-7001-4216-8820-5e450453f7fe req-f0bb14c7-bfd5-4ab6-b176-36ef7bbcb4d8 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-0e15bb74-c6f8-4b79-a804-d8561663ea89-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:43 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d" returned: 0 in 0.508s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42759e5d-de80-4583-9eef-61826b77348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0d61a5-ccfd-4718-ada2-196306f8f4b6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "cinder-b9bd2e17-be4d-4ebb-b452-07520dec209f-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-b9bd2e17-be4d-4ebb-b452-07520dec209f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:43 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a Sep 29 12:00:43 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "cinder-quobyte-b9bd2e17-be4d-4ebb-b452-07520dec209f" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-quobyte-b9bd2e17-be4d-4ebb-b452-07520dec209f" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a10d002-a8ad-4c72-a279-5da6b656d858]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:44 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f Sep 29 12:00:44 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:44 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a" returned: 0 in 0.639s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:44 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 Sep 29 12:00:44 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Flow 'volume_create_manager' (42f59cac-0801-471a-845f-be541a9602a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2669764-1e5c-4bf4-9721-59d10568c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:44 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f" returned: 0 in 0.594s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2669764-1e5c-4bf4-9721-59d10568c580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-905009095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cb8330-56cf-4cc6-a309-ea1281c76b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e43764c9841ea9a959710f2a68f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:45Z,use_quota=True,user_id='695b0eb1c82942fa9a528e9e49d851d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd94c62d-a66c-4105-a568-aec9d8f25deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:44 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f Sep 29 12:00:44 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd94c62d-a66c-4105-a568-aec9d8f25deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa559d6-7cb0-48ce-a8ed-c2726f66808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa559d6-7cb0-48ce-a8ed-c2726f66808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cb8330-56cf-4cc6-a309-ea1281c76b66', 'volume_name': 'volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73afad45-7159-4d08-9957-3b38dd26c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73afad45-7159-4d08-9957-3b38dd26c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87fcb13-9f45-4c3f-84e2-cba49fee54e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:44 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Volume f7cb8330-56cf-4cc6-a309-ea1281c76b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66', 'volume_size': 1} Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:44 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9bd2e17-be4d-4ebb-b452-07520dec209f" returned: 0 in 0.296s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-quobyte-b9bd2e17-be4d-4ebb-b452-07520dec209f" released by "delete_volume" :: held 0.982s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG cinder.quota [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Created reservations ['6d18d706-1e52-4a33-b0dd-9cc40c9b5e50', 'b8eba362-8e44-4059-877f-648dad7982b1', 'd0f7e909-f8fc-4f26-b9c8-8089679bb5f0', '5f682b87-0935-48a2-839a-c707e6ff852e'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:45 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:45 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:45 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.635s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG cinder.manager [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Deleted volume successfully. Sep 29 12:00:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-f175ef8a-6168-47e4-8251-7ae4de59d1fc req-f924d973-34fb-41c4-9975-2a1158438f00 tempest-VolumesSnapshotsTestJSON-820956299 None] Lock "cinder-b9bd2e17-be4d-4ebb-b452-07520dec209f-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50" returned: 0 in 8.487s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:52 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:00:52 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Converted 1024.00 MB image at 120.64 MB/s Sep 29 12:00:52 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 12:00:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:52 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 Sep 29 12:00:52 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:53 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50" returned: 0 in 0.265s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-804e19ac-5f3d-486d-8071-ab560b6a4f50" released by "_copy_volume_from_snapshot" :: held 10.033s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Acquiring lock "cinder-quobyte-7f9bb0f9-d4d7-431f-9812-19a1c905864d" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-7f9bb0f9-d4d7-431f-9812-19a1c905864d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Deleting offline snapshot 7f9bb0f9-d4d7-431f-9812-19a1c905864d of volume 42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] snapshot_file for this snap is: volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f202344a-5757-4a32-84a0-275851e47060]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:53 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d Sep 29 12:00:53 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:53 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d" returned: 0 in 0.460s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42759e5d-de80-4583-9eef-61826b77348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[69384f56-52f3-4132-8693-8051f7cf25a8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Flow 'volume_create_manager' (f35a5651-6c58-4963-b2a6-c1513e3084af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d3756-a948-48df-8492-10fbd2335554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:53 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d3756-a948-48df-8492-10fbd2335554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-384553256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe73f778-0d2f-4301-abb2-bf9a39aba298,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1897155077714189854aeb8fe9433fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:54Z,use_quota=True,user_id='5d2aa15d28e0448d8a0d5cbb5c212924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:53 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17782600-0156-4956-86f6-40e468c9a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17782600-0156-4956-86f6-40e468c9a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbe889e-e1a5-4a23-87d8-8b0001fb12d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbe889e-e1a5-4a23-87d8-8b0001fb12d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe73f778-0d2f-4301-abb2-bf9a39aba298', 'volume_name': 'volume-fe73f778-0d2f-4301-abb2-bf9a39aba298', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f483a78e-e6db-453e-a21e-97c4944db93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f483a78e-e6db-453e-a21e-97c4944db93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434a61b3-a1bf-4ff2-875a-8ac97b1bc79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Volume fe73f778-0d2f-4301-abb2-bf9a39aba298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe73f778-0d2f-4301-abb2-bf9a39aba298', 'volume_size': 1} Sep 29 12:00:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Flow 'volume_create_manager' (f512bcf2-54e9-4d96-97b7-1388710d462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e39079-5b69-4d6d-b98e-41060db543c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e39079-5b69-4d6d-b98e-41060db543c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-526920784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c1b210-1958-49ee-889e-c2d2edf26ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401d20301d954f00badcb127b8ad990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:54Z,use_quota=True,user_id='760a38ad9c0647148a961f2aa4511b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d1bb3a-a6d8-4032-87d1-0a7cf87ba3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d1bb3a-a6d8-4032-87d1-0a7cf87ba3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e15ec-13eb-480a-8103-a9aa7d06ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e15ec-13eb-480a-8103-a9aa7d06ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c1b210-1958-49ee-889e-c2d2edf26ee6', 'volume_name': 'volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137b6ef9-d243-4b8b-a3d2-f40b0a56f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137b6ef9-d243-4b8b-a3d2-f40b0a56f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99daea79-b5ba-4639-a2c2-594d3331affd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:54 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Volume e8c1b210-1958-49ee-889e-c2d2edf26ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6', 'volume_size': 1} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:54 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a" returned: 0 in 0.589s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:54 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d Sep 29 12:00:54 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:54 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d" returned: 0 in 0.312s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:54 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d Sep 29 12:00:54 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:54 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a.7f9bb0f9-d4d7-431f-9812-19a1c905864d" returned: 0 in 0.235s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-7f9bb0f9-d4d7-431f-9812-19a1c905864d" released by "_delete_snapshot" :: held 1.719s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.457s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.198s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-905009095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cb8330-56cf-4cc6-a309-ea1281c76b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e43764c9841ea9a959710f2a68f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:45Z,use_quota=True,user_id='695b0eb1c82942fa9a528e9e49d851d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Creating volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:54 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:54 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 1073741824 Sep 29 12:00:54 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a4575ea7-a2d6-4ed2-bc5e-f75e6b792ab5 tempest-GroupsV314Test-47685642 None] Create group from source-group-b8681f2d-1cda-4e0e-ab9e-ee3267e288be completed successfully. Sep 29 12:00:55 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 1073741824" returned: 0 in 0.413s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:55 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 Sep 29 12:00:55 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:55 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66" returned: 0 in 0.260s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-384553256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe73f778-0d2f-4301-abb2-bf9a39aba298,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1897155077714189854aeb8fe9433fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:54Z,use_quota=True,user_id='5d2aa15d28e0448d8a0d5cbb5c212924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Creating volume fe73f778-0d2f-4301-abb2-bf9a39aba298 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:55 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Acquiring lock "cinder-quobyte-804e19ac-5f3d-486d-8071-ab560b6a4f50" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87fcb13-9f45-4c3f-84e2-cba49fee54e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:55 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 1073741824 Sep 29 12:00:55 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba1998-04a9-4779-be13-2811204f6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:55 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Volume volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 (f7cb8330-56cf-4cc6-a309-ea1281c76b66): created successfully Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba1998-04a9-4779-be13-2811204f6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Flow 'volume_create_manager' (42f59cac-0801-471a-845f-be541a9602a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-804e19ac-5f3d-486d-8071-ab560b6a4f50" acquired by "delete_volume" :: waited 0.064s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9165b3de-7d7e-4afc-9901-c785e4f19713 tempest-SnapshotsActionsTest-42222505 None] Created volume successfully. Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[874880d1-b288-4fc0-8b00-ebd6a6411b7d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:55 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 Sep 29 12:00:55 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:56 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 1073741824" returned: 0 in 0.517s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:56 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 Sep 29 12:00:56 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:56 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50" returned: 0 in 0.450s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:56 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50 Sep 29 12:00:56 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:56 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298" returned: 0 in 0.270s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-526920784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c1b210-1958-49ee-889e-c2d2edf26ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401d20301d954f00badcb127b8ad990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:54Z,use_quota=True,user_id='760a38ad9c0647148a961f2aa4511b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Creating volume e8c1b210-1958-49ee-889e-c2d2edf26ee6 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:56 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:56 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-804e19ac-5f3d-486d-8071-ab560b6a4f50" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:56 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 1073741824 Sep 29 12:00:56 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434a61b3-a1bf-4ff2-875a-8ac97b1bc79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe73f778-0d2f-4301-abb2-bf9a39aba298', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872699e5-4d28-4a4b-98b1-74fc997507e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-804e19ac-5f3d-486d-8071-ab560b6a4f50" released by "delete_volume" :: held 0.809s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:56 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Volume volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 (fe73f778-0d2f-4301-abb2-bf9a39aba298): created successfully Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872699e5-4d28-4a4b-98b1-74fc997507e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Flow 'volume_create_manager' (f35a5651-6c58-4963-b2a6-c1513e3084af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:56 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d2a9b2d9-9a83-4c8e-988d-02bc0e44d019 tempest-VolumesTestJSON-1227194918 None] Created volume successfully. Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Created reservations ['88f04f4d-0093-4471-962d-6e9baef4e84a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:56 devstack cinder-volume[86117]: WARNING cinder.quota [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2054815575 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2054815575, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:56 devstack cinder-volume[86117]: WARNING cinder.quota [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2054815575 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2054815575, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Created reservations ['ffaeb63d-dd12-4449-97f5-b8578e207658', 'feb7f977-0d7a-49a0-9693-35b6e48a5e95', '9c5653fa-d083-4933-a62f-2032e20f00fe', 'e33d127b-0fd3-461f-a614-6ab6074a3eb4'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:56 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:56 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:57 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 1073741824" returned: 0 in 0.529s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:57 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.283s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-96424fcf-0aca-4b40-8f8b-2c3262074532 tempest-GroupsV314Test-47685642 None] Delete group completed successfully. Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:57 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 Sep 29 12:00:57 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Acquiring lock "cinder-quobyte-42759e5d-de80-4583-9eef-61826b77348a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-42759e5d-de80-4583-9eef-61826b77348a" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557074f-8a5d-4f2a-b200-9b7beb918854]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:57 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a Sep 29 12:00:57 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:57 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6" returned: 0 in 0.347s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.351s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99daea79-b5ba-4639-a2c2-594d3331affd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9757ee-2a86-4651-a133-09953e96f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Creating offline snapshot c576781a-7f1a-4146-8305-eb343028a25a of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:00:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Volume volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 (e8c1b210-1958-49ee-889e-c2d2edf26ee6): created successfully Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9757ee-2a86-4651-a133-09953e96f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Flow 'volume_create_manager' (f512bcf2-54e9-4d96-97b7-1388710d462b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a6108-8875-4b0e-9c23-94434ef66c65]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3a759c16-c904-4f4b-a7f5-75ba52fa67df tempest-VolumesServicesTestJSON-510394596 None] Created volume successfully. Sep 29 12:00:57 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 Sep 29 12:00:57 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:00:57 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Flow 'volume_create_manager' (e458003a-d209-4fde-970d-d5e71f59df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a06a1f0-fc6e-4a2c-b565-eca5ce318fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a" returned: 0 in 0.471s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a06a1f0-fc6e-4a2c-b565-eca5ce318fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-49918868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81b7c15-e059-47e2-b646-c5d25e392ea5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1897155077714189854aeb8fe9433fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:58Z,use_quota=True,user_id='5d2aa15d28e0448d8a0d5cbb5c212924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:57 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a Sep 29 12:00:57 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae74ebb3-b191-45e7-9323-cd59a47ada62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae74ebb3-b191-45e7-9323-cd59a47ada62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10dac32-1b3a-4faa-8561-c662d1eda0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10dac32-1b3a-4faa-8561-c662d1eda0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81b7c15-e059-47e2-b646-c5d25e392ea5', 'volume_name': 'volume-a81b7c15-e059-47e2-b646-c5d25e392ea5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8822c9c1-3a34-4a16-b86c-650b08da801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8822c9c1-3a34-4a16-b86c-650b08da801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a16ad4-71ac-4dc7-aaed-43b41f1f0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:00:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Volume a81b7c15-e059-47e2-b646-c5d25e392ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81b7c15-e059-47e2-b646-c5d25e392ea5', 'volume_size': 1} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:57 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66" returned: 0 in 0.393s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:57 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a 1G Sep 29 12:00:57 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:57 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42759e5d-de80-4583-9eef-61826b77348a" returned: 0 in 0.246s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Lock "cinder-quobyte-42759e5d-de80-4583-9eef-61826b77348a" released by "delete_volume" :: held 0.817s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Created reservations ['9c20af97-53e1-4b64-81fa-ef76d3f27890'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Created reservations ['06e069b2-b075-4ae6-ad3f-06f826a8ad21', '2d038a24-854d-4af9-bac6-f34ed2f11435', 'fd343318-3a99-46b5-9599-f1e3f2578fdc', 'ff16b2ee-c197-4308-a085-ea39ddcf92b5'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:58 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:58 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:58 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a 1G" returned: 0 in 0.492s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:58 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:00:58 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:58 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.319s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6a5c020e-e286-4bfb-85a0-27e792303337 tempest-GroupsV314Test-47685642 None] Delete group completed successfully. Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Acquiring lock "cinder-e8c1b210-1958-49ee-889e-c2d2edf26ee6-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Lock "cinder-e8c1b210-1958-49ee-889e-c2d2edf26ee6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Acquiring lock "cinder-quobyte-e8c1b210-1958-49ee-889e-c2d2edf26ee6" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Lock "cinder-quobyte-e8c1b210-1958-49ee-889e-c2d2edf26ee6" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346c3db-a69b-4494-918f-09e50257c610]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:58 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.374s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:58 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a is being set with open permissions: ugo+rw Sep 29 12:00:58 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 Sep 29 12:00:58 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:58 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:00:58 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:59 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.259s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:59 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6" returned: 0 in 0.391s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:59 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6 Sep 29 12:00:59 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:59 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.info Sep 29 12:00:59 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:59 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e8c1b210-1958-49ee-889e-c2d2edf26ee6" returned: 0 in 0.302s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Lock "cinder-quobyte-e8c1b210-1958-49ee-889e-c2d2edf26ee6" released by "delete_volume" :: held 0.770s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:00:59 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.info" returned: 0 in 0.299s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:59 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.info is being set with open permissions: ugo+rw Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:59 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.info Sep 29 12:00:59 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Created reservations ['2a75bbdf-08b8-4d5d-81fb-4436d9985950', '78ef75d7-7bf6-4a51-a13b-abba896640da', 'decf22c7-45be-45b4-964c-245217a95841', 'baa4eb05-745d-4df9-91a9-4c1ac394ea47'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:59 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:00:59 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:59 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.info" returned: 0 in 0.289s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-49918868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81b7c15-e059-47e2-b646-c5d25e392ea5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1897155077714189854aeb8fe9433fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:00:58Z,use_quota=True,user_id='5d2aa15d28e0448d8a0d5cbb5c212924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Creating volume a81b7c15-e059-47e2-b646-c5d25e392ea5 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:00:59 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:00:59 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 1073741824 Sep 29 12:00:59 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:00:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a9d12c90-69a2-408c-876d-07b369c96530 tempest-SnapshotsActionsTest-42222505 None] Create snapshot completed successfully Sep 29 12:00:59 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.353s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:00:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Deleted volume successfully. Sep 29 12:00:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3865f071-1101-4d85-abf8-6d87a34f864b tempest-VolumesServicesTestJSON-510394596 None] Lock "cinder-e8c1b210-1958-49ee-889e-c2d2edf26ee6-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:00 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 1073741824" returned: 0 in 0.562s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:00 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 Sep 29 12:01:00 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:00 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5" returned: 0 in 0.316s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a16ad4-71ac-4dc7-aaed-43b41f1f0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81b7c15-e059-47e2-b646-c5d25e392ea5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd514bf9-4f7b-49ef-9c9e-9c1da9b1f876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Volume volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 (a81b7c15-e059-47e2-b646-c5d25e392ea5): created successfully Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd514bf9-4f7b-49ef-9c9e-9c1da9b1f876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Flow 'volume_create_manager' (e458003a-d209-4fde-970d-d5e71f59df50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e2970ab8-b8a7-40a5-b203-8bf172dc56f5 tempest-VolumesTestJSON-1227194918 None] Created volume successfully. Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Creating offline snapshot a80420ac-4981-45cf-a9c5-688c2fd236a1 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1030e0e9-a977-4032-9f2d-93e22cb7ddd6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:01 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:01 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:01 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Flow 'volume_create_manager' (2e67650e-0b16-4d3a-bf8c-30f709b400cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab3b354-7dfe-44ad-9509-0b575a13916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.462s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:01 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 1G Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab3b354-7dfe-44ad-9509-0b575a13916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-153623440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5808801-a871-4c75-b2c3-a1bd7a5ee544,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1897155077714189854aeb8fe9433fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:02Z,use_quota=True,user_id='5d2aa15d28e0448d8a0d5cbb5c212924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:01 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faff78e9-08a4-4fbb-bca5-d61af09bc342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faff78e9-08a4-4fbb-bca5-d61af09bc342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da65b3ce-a8d7-40c5-a67c-328cd72bae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da65b3ce-a8d7-40c5-a67c-328cd72bae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5808801-a871-4c75-b2c3-a1bd7a5ee544', 'volume_name': 'volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de942380-52e3-4df9-94c1-3b06c99ff7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de942380-52e3-4df9-94c1-3b06c99ff7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98d24f4-e508-4bc8-a9ee-3f5aa93587f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:01 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Volume d5808801-a871-4c75-b2c3-a1bd7a5ee544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544', 'volume_size': 1} Sep 29 12:01:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:02 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 1G" returned: 0 in 0.597s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:02 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 Sep 29 12:01:02 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:02 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1" returned: 0 in 0.328s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:02 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 is being set with open permissions: ugo+rw Sep 29 12:01:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:02 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 Sep 29 12:01:02 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:03 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1" returned: 0 in 0.273s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-153623440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5808801-a871-4c75-b2c3-a1bd7a5ee544,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1897155077714189854aeb8fe9433fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:02Z,use_quota=True,user_id='5d2aa15d28e0448d8a0d5cbb5c212924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Creating volume d5808801-a871-4c75-b2c3-a1bd7a5ee544 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:01:03 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:03 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 1073741824 Sep 29 12:01:03 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-336977e2-5f05-47cf-adb1-85e878c53c61 tempest-SnapshotsActionsTest-42222505 None] Create snapshot completed successfully Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-a80420ac-4981-45cf-a9c5-688c2fd236a1-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-a80420ac-4981-45cf-a9c5-688c2fd236a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-a80420ac-4981-45cf-a9c5-688c2fd236a1" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-a80420ac-4981-45cf-a9c5-688c2fd236a1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Deleting offline snapshot a80420ac-4981-45cf-a9c5-688c2fd236a1 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] snapshot_file for this snap is: volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c5840a-8fa8-4cf8-91bf-865eba64e996]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:03 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 1073741824" returned: 0 in 0.582s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:03 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 Sep 29 12:01:03 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:03 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 Sep 29 12:01:03 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:04 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544" returned: 0 in 0.317s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98d24f4-e508-4bc8-a9ee-3f5aa93587f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52901426-d201-4eac-9920-45371a115551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:04 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Volume volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 (d5808801-a871-4c75-b2c3-a1bd7a5ee544): created successfully Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52901426-d201-4eac-9920-45371a115551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Flow 'volume_create_manager' (2e67650e-0b16-4d3a-bf8c-30f709b400cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:04 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-be1cd0db-a29a-4799-9ed2-5011ab0f6c40 tempest-VolumesTestJSON-1227194918 None] Created volume successfully. Sep 29 12:01:04 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1" returned: 0 in 0.509s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[00baf5d5-1595-4cd2-a463-bc4f3628f988]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:04 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:04 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:04 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.395s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:04 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 Sep 29 12:01:04 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:05 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:05 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1 Sep 29 12:01:05 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:05 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.a80420ac-4981-45cf-a9c5-688c2fd236a1" returned: 0 in 0.260s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-a80420ac-4981-45cf-a9c5-688c2fd236a1" released by "_delete_snapshot" :: held 1.723s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" released by "delete_snapshot" :: held 1.755s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:05 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Created reservations ['4ad88592-d896-4360-940c-b114e54a5603', 'b1b2537b-27d7-4530-8d7f-5ec6725fd519', '6d1374a4-1a6c-4353-a7ae-7556ce43e2fc', '72669101-800b-4911-9fe4-57c6c9eff499'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:05 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Delete snapshot completed successfully. Sep 29 12:01:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-487a6c62-1003-41e2-a99f-357c8656df04 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-a80420ac-4981-45cf-a9c5-688c2fd236a1-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=144,cinder:UPDATE=171,cinder:INSERT=44,cinder:DELETE=6 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=134,cinder:UPDATE=160,cinder:INSERT=33,cinder:DELETE=15 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Creating offline snapshot f9211f04-02ea-456a-b027-acd8b2eb2a76 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfb8aa8-39d3-4efc-9fca-ecadc486b978]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "cinder-d5808801-a871-4c75-b2c3-a1bd7a5ee544-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-d5808801-a871-4c75-b2c3-a1bd7a5ee544-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:06 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:06 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "cinder-quobyte-d5808801-a871-4c75-b2c3-a1bd7a5ee544" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-quobyte-d5808801-a871-4c75-b2c3-a1bd7a5ee544" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d62a144-8e49-4c22-b3aa-a83b56b1d19b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1c44d441-eb2a-45e5-b64e-c08b914c04f1 tempest-GroupsV320Test-1703432730 None] Group tempest-GroupsV320Test-Group-100279311: creating Sep 29 12:01:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1c44d441-eb2a-45e5-b64e-c08b914c04f1 tempest-GroupsV320Test-1703432730 None] Group tempest-GroupsV320Test-Group-100279311: created successfully Sep 29 12:01:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1c44d441-eb2a-45e5-b64e-c08b914c04f1 tempest-GroupsV320Test-1703432730 None] Create group completed successfully. Sep 29 12:01:06 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 Sep 29 12:01:06 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:06 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.472s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:06 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 1G Sep 29 12:01:06 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:06 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544" returned: 0 in 0.436s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:07 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544 Sep 29 12:01:07 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:07 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d5808801-a871-4c75-b2c3-a1bd7a5ee544" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-quobyte-d5808801-a871-4c75-b2c3-a1bd7a5ee544" released by "delete_volume" :: held 0.763s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:07 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 1G" returned: 0 in 0.524s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:07 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 Sep 29 12:01:07 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Created reservations ['8d6c62bd-1ce4-49ea-b209-dd62bd39cd98', '01a7b0f1-eb58-4694-991f-24e704f5ffda', 'fd235453-3aa3-412c-b234-12c02ec6f5b6', 'fa847b65-7787-4d71-aed2-9e34e95f6e28'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:07 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:07 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "cinder-a81b7c15-e059-47e2-b646-c5d25e392ea5-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-a81b7c15-e059-47e2-b646-c5d25e392ea5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "cinder-quobyte-a81b7c15-e059-47e2-b646-c5d25e392ea5" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-quobyte-a81b7c15-e059-47e2-b646-c5d25e392ea5" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:07 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76" returned: 0 in 0.494s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:07 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 is being set with open permissions: ugo+rw Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74fc9c4-9af7-49a6-866f-95cc9ed48364]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:07 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 Sep 29 12:01:07 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:07 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Deleted volume successfully. Sep 29 12:01:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-16a2de48-67b6-43db-b05d-c31f992b4440 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-d5808801-a871-4c75-b2c3-a1bd7a5ee544-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:07 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 Sep 29 12:01:07 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:08 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:08 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-112c2da2-a6a0-431e-a8c5-455a1a5c8946 tempest-SnapshotsActionsTest-42222505 None] Create snapshot completed successfully Sep 29 12:01:08 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5" returned: 0 in 0.510s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:08 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5 Sep 29 12:01:08 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Created reservations ['24a02074-551e-447b-ac84-33a569c11cd4'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:08 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:08 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:08 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a81b7c15-e059-47e2-b646-c5d25e392ea5" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-quobyte-a81b7c15-e059-47e2-b646-c5d25e392ea5" released by "delete_volume" :: held 0.847s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Created reservations ['f1ee7cb2-bac0-4da0-8c8e-dc97c25d7838', '7c74c502-da96-438e-bc5a-f282dfee5aa2', '9611a4b3-8447-4400-a0cd-7bec980582b0', '8abcde98-7134-4cf1-9452-717a70067491'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:08 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.278s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:08 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-397610f7-1eb1-4a8c-af8f-9f1a2178896d tempest-GroupsV320Test-1703432730 None] Delete group completed successfully. Sep 29 12:01:08 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:08 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Acquiring lock "cinder-fe73f778-0d2f-4301-abb2-bf9a39aba298-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Lock "cinder-fe73f778-0d2f-4301-abb2-bf9a39aba298-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Acquiring lock "cinder-quobyte-fe73f778-0d2f-4301-abb2-bf9a39aba298" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Lock "cinder-quobyte-fe73f778-0d2f-4301-abb2-bf9a39aba298" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d5fa6-fd19-4ed6-9a42-1d64549d43a0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:09 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.289s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Deleted volume successfully. Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7cff051d-f09d-4db2-866d-697896da8ec9 tempest-VolumesTestJSON-1227194918 None] Lock "cinder-a81b7c15-e059-47e2-b646-c5d25e392ea5-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:09 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 Sep 29 12:01:09 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:09 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298" returned: 0 in 0.457s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:09 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298 Sep 29 12:01:09 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-f9211f04-02ea-456a-b027-acd8b2eb2a76-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-f9211f04-02ea-456a-b027-acd8b2eb2a76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-f9211f04-02ea-456a-b027-acd8b2eb2a76" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f9211f04-02ea-456a-b027-acd8b2eb2a76" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Deleting offline snapshot f9211f04-02ea-456a-b027-acd8b2eb2a76 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] snapshot_file for this snap is: volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf155ba9-ad1f-4f8b-8c21-bbe2ab316616]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:09 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fe73f778-0d2f-4301-abb2-bf9a39aba298" returned: 0 in 0.326s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Lock "cinder-quobyte-fe73f778-0d2f-4301-abb2-bf9a39aba298" released by "delete_volume" :: held 0.843s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Created reservations ['c73a7480-d998-4bee-a222-3ce1df397f41', 'bdc413eb-b6bc-4fb2-8073-7c19f3aa4a2b', 'df17202c-bc0e-45e1-8fdb-2d2ca0754744', 'cf71e04a-99c2-43e9-9147-1dc5f8646ff3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:09 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 Sep 29 12:01:09 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:09 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:09 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:10 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.304s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Deleted volume successfully. Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-157aac5a-9bc6-4e1c-999a-336d56e677bd tempest-VolumesTestJSON-1227194918 None] Lock "cinder-fe73f778-0d2f-4301-abb2-bf9a39aba298-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:10 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76" returned: 0 in 0.557s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54247cf-516a-4f48-9907-c28b93a51010]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:10 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:10 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:10 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.506s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:10 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 Sep 29 12:01:10 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:11 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76" returned: 0 in 0.697s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:11 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76 Sep 29 12:01:11 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:11 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f9211f04-02ea-456a-b027-acd8b2eb2a76" returned: 0 in 0.318s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f9211f04-02ea-456a-b027-acd8b2eb2a76" released by "_delete_snapshot" :: held 2.238s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" released by "delete_snapshot" :: held 2.279s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:11 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Created reservations ['5387a164-0040-4d6a-8085-c46c745d739f', 'ce7f4cd3-f953-49e0-9451-4c80187ea046', 'deb0ae47-0085-4765-971f-09ea653ac38e', '0c7ed3d6-d4f0-489a-a4ec-09258961dd2e'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:12 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Delete snapshot completed successfully. Sep 29 12:01:12 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:12 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c6dd84e6-165d-401d-a757-d88a1efdc1c8 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-f9211f04-02ea-456a-b027-acd8b2eb2a76-delete_snapshot" released by "delete_snapshot" :: held 2.533s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:12 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.344s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:01:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Creating offline snapshot ba10b6ec-1e27-495f-8c99-77fd9c108193 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a97b6fe-2983-49ff-81ae-167cff4da3bc]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:13 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:13 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:13 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.436s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:13 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 1G Sep 29 12:01:13 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:14 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 1G" returned: 0 in 0.574s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:14 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 Sep 29 12:01:14 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:14 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193" returned: 0 in 0.344s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:14 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 is being set with open permissions: ugo+rw Sep 29 12:01:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:14 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 Sep 29 12:01:14 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:14 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:15 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bbfc82ad-0336-4722-be20-97d5e7766f73 tempest-SnapshotsActionsTest-42222505 None] Create snapshot completed successfully Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-ba10b6ec-1e27-495f-8c99-77fd9c108193-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-ba10b6ec-1e27-495f-8c99-77fd9c108193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-ba10b6ec-1e27-495f-8c99-77fd9c108193" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-ba10b6ec-1e27-495f-8c99-77fd9c108193" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Deleting offline snapshot ba10b6ec-1e27-495f-8c99-77fd9c108193 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] snapshot_file for this snap is: volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4514a16-4845-47a9-b901-d7fb8e1b02f3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:15 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 Sep 29 12:01:15 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:16 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193" returned: 0 in 0.419s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[215c3c69-b578-4a82-ba31-2a7ff58a9f23]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:16 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:16 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:16 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.403s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:16 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 Sep 29 12:01:16 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:16 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193" returned: 0 in 0.515s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:17 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193 Sep 29 12:01:17 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:17 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.ba10b6ec-1e27-495f-8c99-77fd9c108193" returned: 0 in 0.357s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-ba10b6ec-1e27-495f-8c99-77fd9c108193" released by "_delete_snapshot" :: held 1.827s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" released by "delete_snapshot" :: held 1.862s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:17 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Created reservations ['085eeb5b-0514-4e06-b493-a72bbaa71a0a', '863b094d-4a46-4a4f-832d-9b4de6070538', '01cbc7b6-94a4-4e93-a3c7-5fff44a01d5a', 'cd771af2-14c8-4325-8e3a-2109aa4c51ed'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f88b6fd6-6712-4624-8a8b-ba6a203e4a5d tempest-GroupsTest-872631729 None] Group tempest-Group1-465061769: creating Sep 29 12:01:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f88b6fd6-6712-4624-8a8b-ba6a203e4a5d tempest-GroupsTest-872631729 None] Group tempest-Group1-465061769: created successfully Sep 29 12:01:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f88b6fd6-6712-4624-8a8b-ba6a203e4a5d tempest-GroupsTest-872631729 None] Create group completed successfully. Sep 29 12:01:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Delete snapshot completed successfully. Sep 29 12:01:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-08bc2225-707c-4a9f-93e5-952a7ed64701 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-ba10b6ec-1e27-495f-8c99-77fd9c108193-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Creating offline snapshot f1d507d6-317f-43d1-8d0b-688e872061c0 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfefb2bc-ae24-413e-acf1-2ffb62276dd2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:18 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:18 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:18 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.482s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:18 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 1G Sep 29 12:01:18 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-df45cd3e-9c0e-433a-b27f-9b97f8e7f037 tempest-GroupsTest-872631729 None] Group tempest-Group2-295773662: creating Sep 29 12:01:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-df45cd3e-9c0e-433a-b27f-9b97f8e7f037 tempest-GroupsTest-872631729 None] Group tempest-Group2-295773662: created successfully Sep 29 12:01:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-df45cd3e-9c0e-433a-b27f-9b97f8e7f037 tempest-GroupsTest-872631729 None] Create group completed successfully. Sep 29 12:01:19 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 1G" returned: 0 in 0.647s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:19 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 Sep 29 12:01:19 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:19 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0" returned: 0 in 0.341s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:19 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 is being set with open permissions: ugo+rw Sep 29 12:01:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:19 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 Sep 29 12:01:19 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:19 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0" returned: 0 in 0.329s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cc5477a4-4e04-451c-87c0-7f3b2aac48de tempest-SnapshotsActionsTest-42222505 None] Create snapshot completed successfully Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-f1d507d6-317f-43d1-8d0b-688e872061c0-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-f1d507d6-317f-43d1-8d0b-688e872061c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Acquiring lock "cinder-quobyte-f1d507d6-317f-43d1-8d0b-688e872061c0" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f1d507d6-317f-43d1-8d0b-688e872061c0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Deleting offline snapshot f1d507d6-317f-43d1-8d0b-688e872061c0 of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] snapshot_file for this snap is: volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3854775a-1d87-433d-ac4d-21f9ca3fdc04]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:20 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 Sep 29 12:01:20 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Flow 'volume_create_manager' (12da982d-a42a-4c9f-add3-3bd9b0fcf428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbffb48-71fd-449d-a3a4-eb1d21387f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbffb48-71fd-449d-a3a4-eb1d21387f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976997948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e41e7e60-60f6-4b47-a2e4-63350a222353,host='devstack@QuobyteHD#QuobyteHD',id=2f36747f-1a91-4f0b-8ebb-aa24970d35e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5cf09fdeb64f3cb11ddd0ac0396404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:21Z,use_quota=True,user_id='6ff8c2e71a5d47e59f8c737cbbca8b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e973202f-f16d-4296-bbce-dc83545cf1dc),volume_type_id=e973202f-f16d-4296-bbce-dc83545cf1dc)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829bc006-b395-4ef1-9f3b-92d1aa957805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829bc006-b395-4ef1-9f3b-92d1aa957805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f1a81e-625b-4078-9a61-cad372151838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f1a81e-625b-4078-9a61-cad372151838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f36747f-1a91-4f0b-8ebb-aa24970d35e1', 'volume_name': 'volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba163be1-b533-41dd-8f78-ccb9d8c68c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba163be1-b533-41dd-8f78-ccb9d8c68c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8255f59-afe6-4493-84ef-11fa6aa33d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Volume 2f36747f-1a91-4f0b-8ebb-aa24970d35e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1', 'volume_size': 1} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e41e7e60-60f6-4b47-a2e4-63350a222353,created_at=2026-09-29T10:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976997948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e41e7e60-60f6-4b47-a2e4-63350a222353,host='devstack@QuobyteHD#QuobyteHD',id=2f36747f-1a91-4f0b-8ebb-aa24970d35e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5cf09fdeb64f3cb11ddd0ac0396404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:21Z,use_quota=True,user_id='6ff8c2e71a5d47e59f8c737cbbca8b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e973202f-f16d-4296-bbce-dc83545cf1dc),volume_type_id=e973202f-f16d-4296-bbce-dc83545cf1dc)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Creating volume 2f36747f-1a91-4f0b-8ebb-aa24970d35e1 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:01:20 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:20 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0" returned: 0 in 0.483s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:21 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 1073741824 Sep 29 12:01:21 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[217e497f-d079-45b1-b870-c4153fffcd9c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:21 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:21 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:21 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.449s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:21 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 Sep 29 12:01:21 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:21 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 1073741824" returned: 0 in 0.718s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:21 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 Sep 29 12:01:21 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:21 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0" returned: 0 in 0.498s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:22 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0 Sep 29 12:01:22 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:22 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1" returned: 0 in 0.558s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8255f59-afe6-4493-84ef-11fa6aa33d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012b6d45-f1f6-45dd-9400-ec41f99c56fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Volume volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 (2f36747f-1a91-4f0b-8ebb-aa24970d35e1): created successfully Sep 29 12:01:22 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012b6d45-f1f6-45dd-9400-ec41f99c56fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Flow 'volume_create_manager' (12da982d-a42a-4c9f-add3-3bd9b0fcf428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.f1d507d6-317f-43d1-8d0b-688e872061c0" returned: 0 in 0.395s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f1d507d6-317f-43d1-8d0b-688e872061c0" released by "_delete_snapshot" :: held 1.971s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" released by "delete_snapshot" :: held 2.011s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-56b2af2e-7952-457a-97e7-e40bc90fe289 tempest-GroupsTest-872631729 None] Created volume successfully. Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Created reservations ['aa5e9abe-85fc-4a16-8e6d-33e72834223b', 'b1a206ec-70db-4952-af7a-3dfcfe6d368d', '0fadcda0-2206-41f5-bad9-f8ccee13129c', 'de16f579-029d-4d73-99c4-955b3040f592'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Delete snapshot completed successfully. Sep 29 12:01:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6550c707-2ace-47c1-849b-0feeb71dd736 tempest-SnapshotsActionsTest-703456563 None] Lock "cinder-f1d507d6-317f-43d1-8d0b-688e872061c0-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "cinder-c576781a-7f1a-4146-8305-eb343028a25a-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-c576781a-7f1a-4146-8305-eb343028a25a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Acquiring lock "cinder-quobyte-2f36747f-1a91-4f0b-8ebb-aa24970d35e1" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "cinder-quobyte-c576781a-7f1a-4146-8305-eb343028a25a" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Lock "cinder-quobyte-2f36747f-1a91-4f0b-8ebb-aa24970d35e1" acquired by "delete_volume" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-quobyte-c576781a-7f1a-4146-8305-eb343028a25a" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Deleting offline snapshot c576781a-7f1a-4146-8305-eb343028a25a of volume f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] snapshot_file for this snap is: volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc49c23-f542-44ae-a0ff-b18ca51966b4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec4d30-7df1-4ed0-9284-20add3102570]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:24 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 Sep 29 12:01:24 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:24 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:24 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:24 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1" returned: 0 in 0.466s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:24 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1 Sep 29 12:01:24 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:24 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.474s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06037aa-2d40-48f9-a319-de54929e778a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:25 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 Sep 29 12:01:25 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:25 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2f36747f-1a91-4f0b-8ebb-aa24970d35e1" returned: 0 in 0.308s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Lock "cinder-quobyte-2f36747f-1a91-4f0b-8ebb-aa24970d35e1" released by "delete_volume" :: held 0.897s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Created reservations ['c5532a18-1684-4106-b253-2a2c3ea87f3f'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:25 devstack cinder-volume[86117]: WARNING cinder.quota [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-770265013 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-770265013, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:01:25 devstack cinder-volume[86117]: WARNING cinder.quota [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-770265013 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-770265013, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Created reservations ['8d2f5fb8-0d09-4c1b-bb6e-24d5710904db', '604da99b-5e33-425f-97ce-d5fe92571c1a', 'd9ea45c8-ed6f-4420-ba3b-14f521339243', '3e68cdf1-ec4e-4259-9b23-9368bd97b6a3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:25 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66" returned: 0 in 0.502s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:25 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:25 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:25 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:25 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:25 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.316s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-34435535-0424-4889-9470-a95b23c85366 tempest-GroupsTest-872631729 None] Delete group completed successfully. Sep 29 12:01:25 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.479s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:25 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a Sep 29 12:01:25 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:26 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66.c576781a-7f1a-4146-8305-eb343028a25a" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-quobyte-c576781a-7f1a-4146-8305-eb343028a25a" released by "_delete_snapshot" :: held 1.906s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" released by "delete_snapshot" :: held 1.983s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Created reservations ['de62047c-c6d1-4b6c-bd36-b1d927296628', 'f5bda8ad-a928-4835-adcf-b1b5706b085e', '697e3c34-ec00-457f-b014-0a805ea62811', '93d5af47-a05a-4de9-ab0f-cda2ef107584'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:26 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Delete snapshot completed successfully. Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f408c204-5bec-4c16-ab0d-20b0c9dbca51 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-c576781a-7f1a-4146-8305-eb343028a25a-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Created reservations ['025883eb-0adc-4c83-a7f1-ce34820fc104'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:26 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:26 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:27 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.362s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:27 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c129cc76-4b9b-47e6-bd2a-1119adc23c8b tempest-GroupsTest-872631729 None] Delete group completed successfully. Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "cinder-f7cb8330-56cf-4cc6-a309-ea1281c76b66-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-f7cb8330-56cf-4cc6-a309-ea1281c76b66-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e4d68f-48d5-4976-a295-500b8abf6cde]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:27 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 Sep 29 12:01:27 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:28 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66" returned: 0 in 0.576s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:28 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66 Sep 29 12:01:28 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:28 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f7cb8330-56cf-4cc6-a309-ea1281c76b66" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-quobyte-f7cb8330-56cf-4cc6-a309-ea1281c76b66" released by "delete_volume" :: held 1.047s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c968ab55-332d-44bb-9da9-af2b81a9037c tempest-GroupsTest-872631729 None] Group tempest-GroupsTest-Group-2124976421: creating Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Created reservations ['6d97aa36-6b81-486b-b96e-dd01f981e389', 'a5a54887-6ef5-41e6-bdcb-5eefc8718476', '7e1e28b2-490b-4f4c-8934-80494a33ca2c', '3db0b8b4-c713-4cb6-b88e-10653d02aa75'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c968ab55-332d-44bb-9da9-af2b81a9037c tempest-GroupsTest-872631729 None] Group tempest-GroupsTest-Group-2124976421: created successfully Sep 29 12:01:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c968ab55-332d-44bb-9da9-af2b81a9037c tempest-GroupsTest-872631729 None] Create group completed successfully. Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:28 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:28 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:29 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.308s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:29 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:29 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Deleted volume successfully. Sep 29 12:01:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-574e3c19-9a2e-46f9-b916-b674d2a8fbe9 tempest-SnapshotsActionsTest-42222505 None] Lock "cinder-f7cb8330-56cf-4cc6-a309-ea1281c76b66-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Flow 'volume_create_manager' (443558d9-20ae-4033-9d9b-7168df944e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8434201-2faf-43e1-855d-adb890e46068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8434201-2faf-43e1-855d-adb890e46068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1032517087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f3c99b5-7c70-406c-ad36-a8950d1f0706,host='devstack@QuobyteHD#QuobyteHD',id=f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5cf09fdeb64f3cb11ddd0ac0396404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:31Z,use_quota=True,user_id='6ff8c2e71a5d47e59f8c737cbbca8b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9910207d-de59-4c3d-a026-ee95db89413b),volume_type_id=9910207d-de59-4c3d-a026-ee95db89413b)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6365dfcc-4485-4eb7-a593-0809b525f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6365dfcc-4485-4eb7-a593-0809b525f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3268311d-9d75-4eae-be55-0450eb64feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3268311d-9d75-4eae-be55-0450eb64feb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e', 'volume_name': 'volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634f8cf6-951e-4363-ab70-70a17e498c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634f8cf6-951e-4363-ab70-70a17e498c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0aa9ca-723d-4943-8c45-cb78b76c0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Volume f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e', 'volume_size': 1} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f3c99b5-7c70-406c-ad36-a8950d1f0706,created_at=2026-09-29T10:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1032517087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f3c99b5-7c70-406c-ad36-a8950d1f0706,host='devstack@QuobyteHD#QuobyteHD',id=f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5cf09fdeb64f3cb11ddd0ac0396404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:31Z,use_quota=True,user_id='6ff8c2e71a5d47e59f8c737cbbca8b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9910207d-de59-4c3d-a026-ee95db89413b),volume_type_id=9910207d-de59-4c3d-a026-ee95db89413b)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Creating volume f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:01:30 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:01:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:30 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e 1073741824 Sep 29 12:01:30 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:31 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e 1073741824" returned: 0 in 0.576s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:31 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e Sep 29 12:01:31 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:31 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e" returned: 0 in 0.339s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0aa9ca-723d-4943-8c45-cb78b76c0d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccdba09-b608-4c82-be05-047fa6df8525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Volume volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e (f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e): created successfully Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccdba09-b608-4c82-be05-047fa6df8525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Flow 'volume_create_manager' (443558d9-20ae-4033-9d9b-7168df944e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3931e6f7-f5d6-4b71-8462-6b236eb9583c tempest-GroupsTest-872631729 None] Created volume successfully. Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Flow 'volume_create_manager' (59154b26-e56f-4514-9832-f1a1a19800c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c3a74-f6ed-40a0-9ea3-4ad2d37633c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c3a74-f6ed-40a0-9ea3-4ad2d37633c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014929298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f3c99b5-7c70-406c-ad36-a8950d1f0706,host='devstack@QuobyteHD#QuobyteHD',id=2735bfbc-ddae-4fa3-9b14-978cabd04033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5cf09fdeb64f3cb11ddd0ac0396404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:34Z,use_quota=True,user_id='6ff8c2e71a5d47e59f8c737cbbca8b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9910207d-de59-4c3d-a026-ee95db89413b),volume_type_id=9910207d-de59-4c3d-a026-ee95db89413b)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b9935a-3616-43fb-8415-11e8235e6218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b9935a-3616-43fb-8415-11e8235e6218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba950d9-5dbc-48ef-8a67-28f998a252ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba950d9-5dbc-48ef-8a67-28f998a252ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2735bfbc-ddae-4fa3-9b14-978cabd04033', 'volume_name': 'volume-2735bfbc-ddae-4fa3-9b14-978cabd04033', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818a0566-009d-4780-9a23-c15dc02c4eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818a0566-009d-4780-9a23-c15dc02c4eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfb8d82-b030-435d-a2d9-217c44c679aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:34 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Volume 2735bfbc-ddae-4fa3-9b14-978cabd04033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2735bfbc-ddae-4fa3-9b14-978cabd04033', 'volume_size': 1} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f3c99b5-7c70-406c-ad36-a8950d1f0706,created_at=2026-09-29T10:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014929298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f3c99b5-7c70-406c-ad36-a8950d1f0706,host='devstack@QuobyteHD#QuobyteHD',id=2735bfbc-ddae-4fa3-9b14-978cabd04033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5cf09fdeb64f3cb11ddd0ac0396404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:34Z,use_quota=True,user_id='6ff8c2e71a5d47e59f8c737cbbca8b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9910207d-de59-4c3d-a026-ee95db89413b),volume_type_id=9910207d-de59-4c3d-a026-ee95db89413b)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Creating volume 2735bfbc-ddae-4fa3-9b14-978cabd04033 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:01:34 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:34 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 1073741824 Sep 29 12:01:34 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:34 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 1073741824" returned: 0 in 0.606s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:34 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 Sep 29 12:01:34 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:35 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033" returned: 0 in 0.520s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:01:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfb8d82-b030-435d-a2d9-217c44c679aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2735bfbc-ddae-4fa3-9b14-978cabd04033', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f451d3df-16e5-4678-a510-8e8d0d22c2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:35 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Volume volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 (2735bfbc-ddae-4fa3-9b14-978cabd04033): created successfully Sep 29 12:01:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f451d3df-16e5-4678-a510-8e8d0d22c2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Flow 'volume_create_manager' (59154b26-e56f-4514-9832-f1a1a19800c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-534b9564-3fd5-4a26-b9ee-39df23e7ddf9 tempest-GroupsTest-872631729 None] Created volume successfully. Sep 29 12:01:36 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7bebd62a-a677-42e7-9577-fa36e6625794 tempest-GroupsTest-872631729 None] Update group completed successfully. Sep 29 12:01:38 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-33da4a12-ae08-4e2d-a394-d88bca8603b6 tempest-GroupsTest-872631729 None] Update group completed successfully. Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Flow 'volume_create_manager' (423d1da3-5e6c-493c-be07-140b949d4a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e693a442-3e2f-4b7f-aa1b-ecc65f76611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e693a442-3e2f-4b7f-aa1b-ecc65f76611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1414339937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a76197-ba97-4957-8ee6-0eaa13afd733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd4f91fb1714329a4be6a95aa986c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:38Z,use_quota=True,user_id='bf0259c95f48448c847b8f73185680c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456e9d86-25a8-45d6-b658-b8989c4b5321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456e9d86-25a8-45d6-b658-b8989c4b5321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561ef4cd-4513-44c4-95b8-359574a02075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:38 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561ef4cd-4513-44c4-95b8-359574a02075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1a76197-ba97-4957-8ee6-0eaa13afd733', 'volume_name': 'volume-c1a76197-ba97-4957-8ee6-0eaa13afd733', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c268229-5fc5-458a-8bb4-796676ae6d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c268229-5fc5-458a-8bb4-796676ae6d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c831c27-6a7c-444c-b76b-a01be616c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:39 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Volume c1a76197-ba97-4957-8ee6-0eaa13afd733: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1a76197-ba97-4957-8ee6-0eaa13afd733', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Trying to clone c1a76197-ba97-4957-8ee6-0eaa13afd733 from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:01:39 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0396c866-9503-42fe-b206-07f84fdd992f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:39 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD Sep 29 12:01:39 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:40 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a is fetched for user bf0259c95f48448c847b8f73185680c1. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Acquiring lock "cinder-quobyte-2735bfbc-ddae-4fa3-9b14-978cabd04033" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Lock "cinder-quobyte-2735bfbc-ddae-4fa3-9b14-978cabd04033" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5e9f4e-78db-4227-a2d9-9b67273414f6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7760eaf3-1fd5-47c3-a4f2-b8692388d00e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:40 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD Sep 29 12:01:40 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:40 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 Sep 29 12:01:40 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:40 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1414339937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a76197-ba97-4957-8ee6-0eaa13afd733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd4f91fb1714329a4be6a95aa986c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:38Z,use_quota=True,user_id='bf0259c95f48448c847b8f73185680c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Creating volume c1a76197-ba97-4957-8ee6-0eaa13afd733 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:01:40 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:01:40 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033" returned: 0 in 0.503s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:40 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 1073741824 Sep 29 12:01:40 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:40 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033 Sep 29 12:01:40 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:40 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2735bfbc-ddae-4fa3-9b14-978cabd04033" returned: 0 in 0.302s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Lock "cinder-quobyte-2735bfbc-ddae-4fa3-9b14-978cabd04033" released by "delete_volume" :: held 0.872s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Acquiring lock "cinder-quobyte-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Lock "cinder-quobyte-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[726a4483-1a21-4422-9e5d-0d929535e236]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:41 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e Sep 29 12:01:41 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:41 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 1073741824" returned: 0 in 0.625s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:41 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 Sep 29 12:01:41 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:41 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e" returned: 0 in 0.525s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:41 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e Sep 29 12:01:41 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:41 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733" returned: 0 in 0.428s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Attempting download of 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume c1a76197-ba97-4957-8ee6-0eaa13afd733. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac649c-6ae8-4c93-97cf-49cf245ab51f]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_w1eggf01 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:41 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e" returned: 0 in 0.392s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Lock "cinder-quobyte-f12fd0ea-c337-4f5d-87c8-cee6ae9ec77e" released by "delete_volume" :: held 0.969s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:42 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_w1eggf01 Sep 29 12:01:42 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Created reservations ['6ad69869-6b0d-4bdb-bf65-1bcc870fa835'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:42 devstack cinder-volume[86117]: WARNING cinder.quota [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-171870620 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-171870620, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:01:42 devstack cinder-volume[86117]: WARNING cinder.quota [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-171870620 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-171870620, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Created reservations ['71dd4bcf-a3a7-434d-a4ce-59d6411a2dc1', '0654d517-1495-448a-8f9f-4fcf649e84f8', 'd65b0f12-7ad2-42d1-b076-2d02824c06c1', '54bcfbcb-3438-4650-9c22-765403c8e93d'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Created reservations ['c1085b6f-090d-4457-9cbf-89ae317731f5', '4e7aaf7b-81e9-45b4-8d81-636f25c1509c', '916b7c78-c5c5-47f0-a0e4-bed610697ce2', '7c4a1e61-eb6b-4c64-832a-0fd45d7bf4e7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:42 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_w1eggf01" returned: 0 in 0.380s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_w1eggf01 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:42 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:42 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:42 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_w1eggf01 Sep 29 12:01:42 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:42 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.357s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c21f42fd-1f76-435c-b00f-72bc901a0af0 tempest-GroupsTest-872631729 None] Delete group completed successfully. Sep 29 12:01:42 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_w1eggf01" returned: 1 in 0.517s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_w1eggf01' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba4f739-a004-46c3-8c6c-ac570fd658cf]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:42 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD Sep 29 12:01:42 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:43 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:43 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] 2eff10fc-36b0-4954-8584-fe8c9e38eb2a was qcow2, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:01:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:43 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 Sep 29 12:01:43 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:45 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733" returned: 0 in 2.506s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:45 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_dnqtrpoydevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:01:45 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Converted 112.00 MB image at 44.66 MB/s Sep 29 12:01:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:45 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 1G Sep 29 12:01:45 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:46 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 1G" returned: 0 in 0.461s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Downloaded image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume c1a76197-ba97-4957-8ee6-0eaa13afd733 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a for user bf0259c95f48448c847b8f73185680c1 is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Marking volume c1a76197-ba97-4957-8ee6-0eaa13afd733 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Copying metadata from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a to c1a76197-ba97-4957-8ee6-0eaa13afd733. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Creating volume glance metadata for volume c1a76197-ba97-4957-8ee6-0eaa13afd733 backed by image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c831c27-6a7c-444c-b76b-a01be616c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a76197-ba97-4957-8ee6-0eaa13afd733', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86794768-2fe4-4867-8ceb-f45c2d7c4062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:46 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Volume volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 (c1a76197-ba97-4957-8ee6-0eaa13afd733): created successfully Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86794768-2fe4-4867-8ceb-f45c2d7c4062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Flow 'volume_create_manager' (423d1da3-5e6c-493c-be07-140b949d4a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:46 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-325c440e-1ffb-4872-943c-df8a2e4ba029 tempest-VolumesImageMetadata-1666926567 None] Created volume successfully. Sep 29 12:01:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Acquiring lock "cinder-c1a76197-ba97-4957-8ee6-0eaa13afd733-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Lock "cinder-c1a76197-ba97-4957-8ee6-0eaa13afd733-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Acquiring lock "cinder-quobyte-c1a76197-ba97-4957-8ee6-0eaa13afd733" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Lock "cinder-quobyte-c1a76197-ba97-4957-8ee6-0eaa13afd733" acquired by "delete_volume" :: waited 0.036s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:48 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05b0cb8-e388-4d04-a472-63b6f75e84fb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:48 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 Sep 29 12:01:48 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:49 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733" returned: 0 in 0.626s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:49 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733 Sep 29 12:01:49 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:49 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1a76197-ba97-4957-8ee6-0eaa13afd733" returned: 0 in 0.636s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Lock "cinder-quobyte-c1a76197-ba97-4957-8ee6-0eaa13afd733" released by "delete_volume" :: held 1.347s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Created reservations ['793e1d59-caf8-43e5-966f-bb6005f00c4f', 'db326164-3a9e-4946-8ae9-88dd6a02ea16', '9289525b-6dbd-4fea-b6d6-935baeee8a87', '6085013e-7913-4bd4-ba66-b7530c7748e8'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:50 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:01:50 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:50 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:50 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:01:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Deleted volume successfully. Sep 29 12:01:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bc462c0-f668-4c0d-b3d9-3fd3a1047b75 tempest-VolumesImageMetadata-1666926567 None] Lock "cinder-c1a76197-ba97-4957-8ee6-0eaa13afd733-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Flow 'volume_create_manager' (86ab9146-167a-4e5a-89fe-67c6e864f4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38321d0-3e3c-465f-b04b-58580cf08f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38321d0-3e3c-465f-b04b-58580cf08f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1576108661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a294ce32-aef8-43ba-be70-56b9dc51975a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87ebac276f040ec863dcca6d4513658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:56Z,use_quota=True,user_id='67609b3e03524182b080227080f5aa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478db909-391a-42e8-b958-7592a371bca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478db909-391a-42e8-b958-7592a371bca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4210c48-9a44-41d1-bc75-b194cc600c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4210c48-9a44-41d1-bc75-b194cc600c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a294ce32-aef8-43ba-be70-56b9dc51975a', 'volume_name': 'volume-a294ce32-aef8-43ba-be70-56b9dc51975a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f266fe-5f85-4845-8dd7-721af080afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f266fe-5f85-4845-8dd7-721af080afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e0a911-fcd0-4dc4-a7e2-d0cb3dd17e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:56 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Volume a294ce32-aef8-43ba-be70-56b9dc51975a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a294ce32-aef8-43ba-be70-56b9dc51975a', 'volume_size': 1} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1576108661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a294ce32-aef8-43ba-be70-56b9dc51975a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87ebac276f040ec863dcca6d4513658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:56Z,use_quota=True,user_id='67609b3e03524182b080227080f5aa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Creating volume a294ce32-aef8-43ba-be70-56b9dc51975a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:01:56 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:01:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:56 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a 1073741824 Sep 29 12:01:56 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:57 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a 1073741824" returned: 0 in 0.832s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:57 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a Sep 29 12:01:57 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:58 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a" returned: 0 in 0.356s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e0a911-fcd0-4dc4-a7e2-d0cb3dd17e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a294ce32-aef8-43ba-be70-56b9dc51975a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eac40ae-544e-4ff1-93fd-2efbef625638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:58 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Volume volume-a294ce32-aef8-43ba-be70-56b9dc51975a (a294ce32-aef8-43ba-be70-56b9dc51975a): created successfully Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eac40ae-544e-4ff1-93fd-2efbef625638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Flow 'volume_create_manager' (86ab9146-167a-4e5a-89fe-67c6e864f4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c885ad85-e4bf-4c86-860e-a5314c40fe09 tempest-VolumeQuotasAdminTestJSON-166516523 None] Created volume successfully. Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Acquiring lock "cinder-a294ce32-aef8-43ba-be70-56b9dc51975a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "cinder-a294ce32-aef8-43ba-be70-56b9dc51975a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Acquiring lock "cinder-quobyte-a294ce32-aef8-43ba-be70-56b9dc51975a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "cinder-quobyte-a294ce32-aef8-43ba-be70-56b9dc51975a" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec92eb8-dad6-486b-8e86-0a0db413dd95]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (5815c71f-4006-472a-8193-4f5d4ac25cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:59 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907f8f5a-6b0c-4fea-84d3-57385df65321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Flow 'volume_create_manager' (e57145b5-e33d-40da-bf7b-beeb3341a912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07babdd-6cd2-4f97-a44c-258141135d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907f8f5a-6b0c-4fea-84d3-57385df65321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640261536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f5bcdb-4826-4f03-a07d-ca5157935607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:59Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0765c9c-ad8a-41f7-ab24-1e6323c51e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0765c9c-ad8a-41f7-ab24-1e6323c51e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c346de-17e6-4070-b474-80ca2bda52d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c346de-17e6-4070-b474-80ca2bda52d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f5bcdb-4826-4f03-a07d-ca5157935607', 'volume_name': 'volume-c3f5bcdb-4826-4f03-a07d-ca5157935607', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae94d6b8-2032-424b-98d2-717326424964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae94d6b8-2032-424b-98d2-717326424964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55be4d30-7671-4dab-88e3-769efdd128eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Volume c3f5bcdb-4826-4f03-a07d-ca5157935607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f5bcdb-4826-4f03-a07d-ca5157935607', 'volume_size': 1} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640261536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f5bcdb-4826-4f03-a07d-ca5157935607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:59Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Creating volume c3f5bcdb-4826-4f03-a07d-ca5157935607 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:01:59 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07babdd-6cd2-4f97-a44c-258141135d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-928389234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e612b15c-e289-4770-bdaa-f0a6f5c3fc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f38b28ac046b8840256574bedfe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:59Z,use_quota=True,user_id='bcf51899b75442ecb3cccb153a4bd98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c53b755-8a03-421f-8597-26064113d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c53b755-8a03-421f-8597-26064113d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a221dad5-9244-49d6-a8ae-8ebedb8bdf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 1073741824 Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a221dad5-9244-49d6-a8ae-8ebedb8bdf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e612b15c-e289-4770-bdaa-f0a6f5c3fc2a', 'volume_name': 'volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538d98e3-c572-4d3a-948a-123953eab1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538d98e3-c572-4d3a-948a-123953eab1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78940f7-339a-4470-8b2d-711891b75050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:01:59 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Volume e612b15c-e289-4770-bdaa-f0a6f5c3fc2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a', 'volume_size': 1} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:01:59 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a" returned: 0 in 0.603s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:01:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:01:59 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a Sep 29 12:01:59 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:00 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a294ce32-aef8-43ba-be70-56b9dc51975a" returned: 0 in 0.378s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:00 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 1073741824" returned: 0 in 0.687s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "cinder-quobyte-a294ce32-aef8-43ba-be70-56b9dc51975a" released by "delete_volume" :: held 1.062s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:00 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 Sep 29 12:02:00 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Created reservations ['c62e7248-6013-4e5c-90cf-3b72c5eb826e', 'eb97c592-e367-45fc-9820-52d69ff2953b', 'c278aed9-11c5-483e-ac7c-f6a62e7c09a1', '629238e3-4119-499b-a0ce-b7c06478a45e'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:00 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:00 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:00 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607" returned: 0 in 0.361s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-928389234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e612b15c-e289-4770-bdaa-f0a6f5c3fc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f38b28ac046b8840256574bedfe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:01:59Z,use_quota=True,user_id='bcf51899b75442ecb3cccb153a4bd98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Creating volume e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:00 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55be4d30-7671-4dab-88e3-769efdd128eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f5bcdb-4826-4f03-a07d-ca5157935607', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:00 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a 1073741824 Sep 29 12:02:00 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ead06f4-4aa5-4c2e-8627-377bb58a73c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Volume volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 (c3f5bcdb-4826-4f03-a07d-ca5157935607): created successfully Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ead06f4-4aa5-4c2e-8627-377bb58a73c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (5815c71f-4006-472a-8193-4f5d4ac25cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9fd64326-e0ee-4ed6-9afc-1da160dd7213 tempest-VolumesActionsTest-217134331 None] Created volume successfully. Sep 29 12:02:00 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.391s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Deleted volume successfully. Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be39017b-d594-456f-b1c0-4eaa7efe175f tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "cinder-a294ce32-aef8-43ba-be70-56b9dc51975a-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3b6d6b94-22a5-42e8-bce6-87d5887be807 tempest-VolumesActionsTest-217134331 None] Acquiring lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607" by "attach_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3b6d6b94-22a5-42e8-bce6-87d5887be807 tempest-VolumesActionsTest-217134331 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607" acquired by "attach_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3b6d6b94-22a5-42e8-bce6-87d5887be807 tempest-VolumesActionsTest-217134331 None] Attaching volume c3f5bcdb-4826-4f03-a07d-ca5157935607 to instance 4de66b13-8696-47bf-ad03-68c5fd53caf6 at mountpoint /dev/vdb on host None. Sep 29 12:02:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3b6d6b94-22a5-42e8-bce6-87d5887be807 tempest-VolumesActionsTest-217134331 None] Attach volume completed successfully. Sep 29 12:02:01 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3b6d6b94-22a5-42e8-bce6-87d5887be807 tempest-VolumesActionsTest-217134331 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607" released by "attach_volume" :: held 0.190s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a 1073741824" returned: 0 in 0.649s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:01 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a Sep 29 12:02:01 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:01 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" returned: 0 in 0.437s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78940f7-339a-4470-8b2d-711891b75050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1a97ce-850a-477b-b87f-3bd6b99cb470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:01 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Volume volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a (e612b15c-e289-4770-bdaa-f0a6f5c3fc2a): created successfully Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1a97ce-850a-477b-b87f-3bd6b99cb470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Flow 'volume_create_manager' (e57145b5-e33d-40da-bf7b-beeb3341a912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7374c396-f1bc-43ce-b296-5b5396ea76b9 tempest-SnapshotMetadataTestJSON-1182784693 None] Created volume successfully. Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Flow 'volume_create_manager' (44889624-fdd2-4a67-8497-ad0026145f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90fc943-6db5-45d1-8021-c5092cc9af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90fc943-6db5-45d1-8021-c5092cc9af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1583468756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3abfd58-5f7f-4b18-a8a7-ed06083bc47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87ebac276f040ec863dcca6d4513658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:02Z,use_quota=True,user_id='67609b3e03524182b080227080f5aa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f3af93-109f-40d8-81a6-b4264c8073c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f3af93-109f-40d8-81a6-b4264c8073c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a340df-6d8d-4000-927f-63c86152aebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a340df-6d8d-4000-927f-63c86152aebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3abfd58-5f7f-4b18-a8a7-ed06083bc47d', 'volume_name': 'volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e14f07-0273-4495-818e-a97b250b2f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e14f07-0273-4495-818e-a97b250b2f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6579dc0-1209-4a4d-9839-73ae133f836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:02 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Volume d3abfd58-5f7f-4b18-a8a7-ed06083bc47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d', 'volume_size': 1} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1583468756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3abfd58-5f7f-4b18-a8a7-ed06083bc47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87ebac276f040ec863dcca6d4513658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:02Z,use_quota=True,user_id='67609b3e03524182b080227080f5aa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Creating volume d3abfd58-5f7f-4b18-a8a7-ed06083bc47d {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:02 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:02 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d 1073741824 Sep 29 12:02:02 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-97484aed-1c7b-4475-a522-89ff0fa4b297 tempest-VolumesActionsTest-1553554182 None] Terminate volume connection completed successfully. Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97484aed-1c7b-4475-a522-89ff0fa4b297 tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-detach_volume" by "detach_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97484aed-1c7b-4475-a522-89ff0fa4b297 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-97484aed-1c7b-4475-a522-89ff0fa4b297 tempest-VolumesActionsTest-1553554182 None] Detaching volume c3f5bcdb-4826-4f03-a07d-ca5157935607 from instance 4de66b13-8696-47bf-ad03-68c5fd53caf6. Sep 29 12:02:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-97484aed-1c7b-4475-a522-89ff0fa4b297 tempest-VolumesActionsTest-1553554182 None] Detach volume completed successfully. Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97484aed-1c7b-4475-a522-89ff0fa4b297 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe4b8390-4dc1-4043-be7a-80a815ecc377 tempest-VolumesActionsTest-217134331 None] Acquiring lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-detach_volume" by "detach_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe4b8390-4dc1-4043-be7a-80a815ecc377 tempest-VolumesActionsTest-217134331 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fe4b8390-4dc1-4043-be7a-80a815ecc377 tempest-VolumesActionsTest-217134331 None] Volume detach called, but volume not attached. Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe4b8390-4dc1-4043-be7a-80a815ecc377 tempest-VolumesActionsTest-217134331 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:02 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d 1073741824" returned: 0 in 0.698s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:02 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d Sep 29 12:02:02 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Acquiring lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Acquiring lock "cinder-quobyte-c3f5bcdb-4826-4f03-a07d-ca5157935607" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Lock "cinder-quobyte-c3f5bcdb-4826-4f03-a07d-ca5157935607" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:03 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d" returned: 0 in 0.400s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.512s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Creating offline snapshot 1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 of volume e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a207e4-775d-4774-af04-6626412b0187]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6579dc0-1209-4a4d-9839-73ae133f836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0f0483-135a-43b3-8b71-85246b5ce30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb3ff2-3ec0-4b93-8a96-b92031574cc6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:03 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Volume volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d (d3abfd58-5f7f-4b18-a8a7-ed06083bc47d): created successfully Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0f0483-135a-43b3-8b71-85246b5ce30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Flow 'volume_create_manager' (44889624-fdd2-4a67-8497-ad0026145f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8fb4589f-c096-4afe-b3ed-f3cd8fce36f0 tempest-VolumeQuotasAdminTestJSON-166516523 None] Created volume successfully. Sep 29 12:02:03 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 Sep 29 12:02:03 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:03 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a Sep 29 12:02:03 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:03 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" returned: 0 in 0.471s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:03 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:03 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 1G Sep 29 12:02:03 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607" returned: 0 in 0.559s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:03 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607 Sep 29 12:02:03 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:04 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c3f5bcdb-4826-4f03-a07d-ca5157935607" returned: 0 in 0.481s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Lock "cinder-quobyte-c3f5bcdb-4826-4f03-a07d-ca5157935607" released by "delete_volume" :: held 1.128s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Created reservations ['c4eea23c-ceaf-4947-b40b-66f1bde8a80c', '39235bcb-5398-4d01-9d96-ed229e288cb3', '336eee09-e3ba-4b80-8715-e67f38c08077', 'ed49ad55-9889-409a-b952-0a566b6910c2'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:04 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 1G" returned: 0 in 0.680s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:04 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 Sep 29 12:02:04 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:04 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:04 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:05 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" returned: 0 in 0.472s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:05 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 is being set with open permissions: ugo+rw Sep 29 12:02:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:05 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 Sep 29 12:02:05 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:05 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.530s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:05 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:05 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Deleted volume successfully. Sep 29 12:02:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e235e18-81bd-41dd-b89c-d5a31e3981eb tempest-VolumesActionsTest-217134331 None] Lock "cinder-c3f5bcdb-4826-4f03-a07d-ca5157935607-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:05 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" returned: 0 in 0.421s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:05 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.info Sep 29 12:02:05 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:05 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-04a877ce-a291-461f-80cc-0ccd4f9d3e77 tempest-VolumeQuotasAdminTestJSON-529686036 None] Transfer volume completed successfully. Sep 29 12:02:06 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.info" returned: 0 in 0.541s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:06 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.info is being set with open permissions: ugo+rw Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:06 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.info Sep 29 12:02:06 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:06 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.info" returned: 0 in 0.364s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.124s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=140,cinder:UPDATE=149,cinder:INSERT=50,cinder:DELETE=8 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Acquiring lock "cinder-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=135,cinder:UPDATE=153,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:02:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-34e17c64-4495-4eac-956b-ad0c1f8dbb1d tempest-SnapshotMetadataTestJSON-1182784693 None] Create snapshot completed successfully Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Lock "cinder-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Acquiring lock "cinder-quobyte-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Lock "cinder-quobyte-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a742957-c5e1-4847-bcab-de8c0c2d8399]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:06 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d Sep 29 12:02:06 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:07 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d" returned: 0 in 0.561s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:07 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d Sep 29 12:02:07 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:07 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d" returned: 0 in 0.502s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Lock "cinder-quobyte-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d" released by "delete_volume" :: held 1.145s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:07 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Created reservations ['1016f499-7902-4906-a9ef-7d2695e48127', 'db1e205d-7663-43a4-ad7f-53e18bed3890', 'a6b8c04d-ae56-428c-8d4e-4eb9ede621f2', '7b76305a-304c-4377-bea5-a6b0a5c5850c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:08 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:08 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:08 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.320s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:08 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Deleted volume successfully. Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-098726d4-c09a-4012-a7c2-3bda9df457d0 tempest-VolumeQuotasAdminTestJSON-836861194 None] Lock "cinder-d3abfd58-5f7f-4b18-a8a7-ed06083bc47d-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "cinder-1e7bc02d-4662-4b01-a7f7-b206cf1b6e72-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-1e7bc02d-4662-4b01-a7f7-b206cf1b6e72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "cinder-quobyte-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-quobyte-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "cinder-quobyte-1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-quobyte-1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Deleting offline snapshot 1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 of volume e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] snapshot_file for this snap is: volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4942a05b-f85f-4ba1-a78d-4e3a20c35e6b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:08 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 Sep 29 12:02:08 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:09 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" returned: 0 in 0.531s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e3f67-e88a-4fc5-a52b-9794d88a024b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (2fc0313a-b9d1-4819-b170-e8efd42d770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d534699-eb0e-4e36-a68d-af36c5c2b26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d534699-eb0e-4e36-a68d-af36c5c2b26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1175741042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d368d0-104c-4796-9c55-3bc29cd9aa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:09Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:09 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a Sep 29 12:02:09 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d110af-d206-4753-8f08-82b9cdf9704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d110af-d206-4753-8f08-82b9cdf9704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3301f02-ad80-4fe2-affe-639f945cea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3301f02-ad80-4fe2-affe-639f945cea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d368d0-104c-4796-9c55-3bc29cd9aa3c', 'volume_name': 'volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09afe439-c811-4ec9-9b5c-39d8a7e8c46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09afe439-c811-4ec9-9b5c-39d8a7e8c46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7078cb-c845-4269-a60e-81c12130bfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:09 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Volume 83d368d0-104c-4796-9c55-3bc29cd9aa3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c', 'volume_size': 1} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1175741042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d368d0-104c-4796-9c55-3bc29cd9aa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:09Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Creating volume 83d368d0-104c-4796-9c55-3bc29cd9aa3c {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:09 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:09 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c 1073741824 Sep 29 12:02:09 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:09 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" returned: 0 in 0.504s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:09 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 Sep 29 12:02:09 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:10 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c 1073741824" returned: 0 in 0.618s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:10 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c Sep 29 12:02:10 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:10 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" returned: 0 in 0.503s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:10 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72 Sep 29 12:02:10 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:10 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c" returned: 0 in 0.293s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7078cb-c845-4269-a60e-81c12130bfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c50f7fe-a2c8-4b18-92e5-4dfedb328fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:10 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Volume volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c (83d368d0-104c-4796-9c55-3bc29cd9aa3c): created successfully Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c50f7fe-a2c8-4b18-92e5-4dfedb328fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (2fc0313a-b9d1-4819-b170-e8efd42d770d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c0337992-e69a-4d88-84f1-034b51f9b3bb tempest-VolumesActionsTest-217134331 None] Created volume successfully. Sep 29 12:02:10 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a.1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" returned: 0 in 0.303s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-quobyte-1e7bc02d-4662-4b01-a7f7-b206cf1b6e72" released by "_delete_snapshot" :: held 2.031s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-quobyte-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" released by "delete_snapshot" :: held 2.065s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Created reservations ['ad5238a8-bf81-4b5a-824a-c32fa0bb3d3d', '64aa007f-b551-4a56-9843-4ed868d736b7', '4de27be2-5d42-45d5-9ca0-3d1d9a0c7a42', 'c1fe99ea-e90a-43ec-bb71-d310d9952bd3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Delete snapshot completed successfully. Sep 29 12:02:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d2fe7ba-2246-436c-be6f-d26c92f12a75 tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-1e7bc02d-4662-4b01-a7f7-b206cf1b6e72-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-83d368d0-104c-4796-9c55-3bc29cd9aa3c-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-83d368d0-104c-4796-9c55-3bc29cd9aa3c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-quobyte-83d368d0-104c-4796-9c55-3bc29cd9aa3c" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-83d368d0-104c-4796-9c55-3bc29cd9aa3c" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:11 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99bb95c-0908-446a-9970-4a7cd6b869bd]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:12 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c Sep 29 12:02:12 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "cinder-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:12 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:12 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "cinder-quobyte-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-quobyte-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" acquired by "delete_volume" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e83939a-80a7-4fa2-9618-f4d31b7b6029]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:12 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c" returned: 0 in 0.595s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:12 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.417s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:02:12 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c Sep 29 12:02:12 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:12 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a Sep 29 12:02:12 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:12 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-83d368d0-104c-4796-9c55-3bc29cd9aa3c" returned: 0 in 0.290s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-83d368d0-104c-4796-9c55-3bc29cd9aa3c" released by "delete_volume" :: held 0.966s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:12 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" returned: 0 in 0.533s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:12 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a Sep 29 12:02:12 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Created reservations ['29d03a98-6f3a-497f-abf7-e3a1df9808e0', 'b53f5967-4150-42a2-ab34-80f19b997c9f', '5e9652f6-29c1-4410-8bd2-ba4d9c61e418', 'aca826bf-5375-43dd-8cf3-1debedc2fae7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:13 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:13 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:13 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" returned: 0 in 0.288s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-quobyte-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a" released by "delete_volume" :: held 0.949s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Created reservations ['77b3d983-d12d-4514-96e8-3b8f7dff3e22', 'a7b16a2b-4b31-47ad-b54c-866be9a4b251', 'e132d723-f3f9-4572-a53d-1ac9c3d4aa2e', 'df615732-fe87-4385-a867-0933ccfe0e69'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:13 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.350s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Deleted volume successfully. Sep 29 12:02:13 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:13 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-78bbd090-4329-462a-a46d-91c3febfc634 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-83d368d0-104c-4796-9c55-3bc29cd9aa3c-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:13 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.298s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Deleted volume successfully. Sep 29 12:02:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ebce3f9-1653-4f05-9759-aaeb050e0cbc tempest-SnapshotMetadataTestJSON-1182784693 None] Lock "cinder-e612b15c-e289-4770-bdaa-f0a6f5c3fc2a-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (a539bb14-172e-404b-8549-1ba1f521ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e190d01a-20bf-401b-bb9a-90e410bd09d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e190d01a-20bf-401b-bb9a-90e410bd09d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363775156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b55fbb0-eb59-4a0d-be5f-594ec2ae6935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:15Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a59cbe6-4173-4526-9333-afa679eee74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a59cbe6-4173-4526-9333-afa679eee74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdee92c-3812-4890-8e40-5a6f2f4f611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdee92c-3812-4890-8e40-5a6f2f4f611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b55fbb0-eb59-4a0d-be5f-594ec2ae6935', 'volume_name': 'volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babdf77a-a896-4209-ba76-4c6828bd9768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babdf77a-a896-4209-ba76-4c6828bd9768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd6b1e2-a2cf-43a2-93d6-4b5a2f21b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:14 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Volume 2b55fbb0-eb59-4a0d-be5f-594ec2ae6935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935', 'volume_size': 1} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363775156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b55fbb0-eb59-4a0d-be5f-594ec2ae6935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:15Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Creating volume 2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:14 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:14 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 1073741824 Sep 29 12:02:14 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Flow 'volume_create_manager' (45b9cd0d-2d36-433e-bf80-9bd34236ad3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a57e24a-cd70-4178-8219-4bd657527b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a57e24a-cd70-4178-8219-4bd657527b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-133471568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4319525c-4941-4135-b4bd-d6c2b8551e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29bd5c616c4051bd00b25b2e82c02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:15Z,use_quota=True,user_id='127bdf4d72934d949056d3558b6c6930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579807b6-1b57-4ee9-ad93-d83995a68ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579807b6-1b57-4ee9-ad93-d83995a68ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479b26e5-1cbd-4661-887d-95adc89750ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479b26e5-1cbd-4661-887d-95adc89750ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4319525c-4941-4135-b4bd-d6c2b8551e30', 'volume_name': 'volume-4319525c-4941-4135-b4bd-d6c2b8551e30', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b82461-3c52-4199-9262-7a54ba0292b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b82461-3c52-4199-9262-7a54ba0292b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548bcb5e-c634-4c49-a3c8-d7836f82e9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:15 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Volume 4319525c-4941-4135-b4bd-d6c2b8551e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4319525c-4941-4135-b4bd-d6c2b8551e30', 'volume_size': 1} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:15 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 1073741824" returned: 0 in 0.472s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:15 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 Sep 29 12:02:15 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:15 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935" returned: 0 in 0.287s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-133471568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4319525c-4941-4135-b4bd-d6c2b8551e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b29bd5c616c4051bd00b25b2e82c02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:15Z,use_quota=True,user_id='127bdf4d72934d949056d3558b6c6930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Creating volume 4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:15 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd6b1e2-a2cf-43a2-93d6-4b5a2f21b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:15 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 1073741824 Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a51723c-c14c-4534-ae49-2057e3086a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:15 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:15 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Volume volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 (2b55fbb0-eb59-4a0d-be5f-594ec2ae6935): created successfully Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a51723c-c14c-4534-ae49-2057e3086a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (a539bb14-172e-404b-8549-1ba1f521ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:15 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3a4924ab-3f12-45d4-a078-4e471f0afaee tempest-VolumesActionsTest-217134331 None] Created volume successfully. Sep 29 12:02:16 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 1073741824" returned: 0 in 0.547s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:16 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 Sep 29 12:02:16 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:16 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30" returned: 0 in 0.276s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548bcb5e-c634-4c49-a3c8-d7836f82e9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4319525c-4941-4135-b4bd-d6c2b8551e30', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b227f6-a3cc-4171-b39c-c30e4738c350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Volume volume-4319525c-4941-4135-b4bd-d6c2b8551e30 (4319525c-4941-4135-b4bd-d6c2b8551e30): created successfully Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b227f6-a3cc-4171-b39c-c30e4738c350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Flow 'volume_create_manager' (45b9cd0d-2d36-433e-bf80-9bd34236ad3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2dcad72f-e5fd-42e8-94a9-a534617a884d tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Created volume successfully. Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Lock "cinder-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-quobyte-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad3d22-28e2-46c7-b25f-2f6f849a812d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:17 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 Sep 29 12:02:17 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Creating offline snapshot 2f472c34-900c-4df9-b560-d1896931afbf of volume 4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[96201202-8d6b-4b4f-8562-9c5f33c0ace0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:17 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 Sep 29 12:02:17 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:17 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935" returned: 0 in 0.511s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:17 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935 Sep 29 12:02:17 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:17 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30" returned: 0 in 0.437s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:17 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf 1G Sep 29 12:02:17 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:17 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935" returned: 0 in 0.325s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935" released by "delete_volume" :: held 0.893s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Created reservations ['982cc09d-7819-4929-a1b9-56c7bc539350', 'd0e6977b-1550-4a8b-9100-0363fc38c6f8', 'da235f5b-003b-4088-bb93-8d9b9ad079df', '8b93e2e9-54c3-4616-a3ce-ad566bbb4c19'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:18 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:18 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:18 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.379s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:18 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Deleted volume successfully. Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf 1G" returned: 0 in 0.687s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4319525c-4941-4135-b4bd-d6c2b8551e30 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:18 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4319525c-4941-4135-b4bd-d6c2b8551e30 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d9bf17de-0150-4dea-9cec-bb66d17c6b8b tempest-VolumesActionsTest-1553554182 None] Lock "cinder-2b55fbb0-eb59-4a0d-be5f-594ec2ae6935-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:18 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (1adea589-ce5f-4680-a005-0f03f7f833ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68117a8b-5b23-4359-b87f-3c7262b93ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68117a8b-5b23-4359-b87f-3c7262b93ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-39319917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9694b7c-c186-4772-9648-2ecd183f7319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:19Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7054cd5a-2bb5-4ca2-8b8c-33d8166bb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7054cd5a-2bb5-4ca2-8b8c-33d8166bb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334dca8f-3cfa-4894-b3da-fbc6afb9fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334dca8f-3cfa-4894-b3da-fbc6afb9fddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9694b7c-c186-4772-9648-2ecd183f7319', 'volume_name': 'volume-a9694b7c-c186-4772-9648-2ecd183f7319', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5962bdb2-640f-4207-88d6-6f60a62dd77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5962bdb2-640f-4207-88d6-6f60a62dd77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186045fe-b92d-4b97-96e8-10aeda8df50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:18 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Volume a9694b7c-c186-4772-9648-2ecd183f7319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9694b7c-c186-4772-9648-2ecd183f7319', 'volume_size': 1} Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:18 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4319525c-4941-4135-b4bd-d6c2b8551e30 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf" returned: 0 in 0.414s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:18 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf is being set with open permissions: ugo+rw Sep 29 12:02:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:18 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf Sep 29 12:02:18 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:19 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf" returned: 0 in 0.287s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:19 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.info Sep 29 12:02:19 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Flow 'volume_create_manager' (f14f50ba-4908-4c56-8ec1-d9650d368e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e729d4bb-455b-40ab-b287-9bbfbbd8bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e729d4bb-455b-40ab-b287-9bbfbbd8bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1907492729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6befca-befc-48e2-925a-01cdd5f5f251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbab6581cad947e2a4bc54ea28e8667f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:19Z,use_quota=True,user_id='dace4f34db8d472c9754056063d46629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629ef5fb-5f3f-498e-83fa-844bd818c9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629ef5fb-5f3f-498e-83fa-844bd818c9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027770d1-e295-4640-bea4-b54a86afcd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027770d1-e295-4640-bea4-b54a86afcd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6befca-befc-48e2-925a-01cdd5f5f251', 'volume_name': 'volume-6f6befca-befc-48e2-925a-01cdd5f5f251', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19a92e4-8673-44de-8235-be54e72282e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19a92e4-8673-44de-8235-be54e72282e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acaff490-ec64-4f32-aeb8-e73cd341ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Volume 6f6befca-befc-48e2-925a-01cdd5f5f251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6befca-befc-48e2-925a-01cdd5f5f251', 'volume_size': 1} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:19 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.info" returned: 0 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:19 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.info is being set with open permissions: ugo+rw Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:19 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.info Sep 29 12:02:19 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Flow 'volume_create_manager' (9d704ccf-806c-4b34-bc05-79f3dccff500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d62d2d-815f-4844-9f9a-a152a96c691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d62d2d-815f-4844-9f9a-a152a96c691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1774259978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76dfe14f-749e-47d6-845a-a4dce376e401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea3ed83d72b4bea8aaf3c7f72e6d1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:20Z,use_quota=True,user_id='5a5d3d43bb1c403abcaab22a21d79113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd79feb-7dbb-42d1-a0c5-302b42125fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd79feb-7dbb-42d1-a0c5-302b42125fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46205547-9e3e-4a3f-8b29-c38e878af4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46205547-9e3e-4a3f-8b29-c38e878af4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76dfe14f-749e-47d6-845a-a4dce376e401', 'volume_name': 'volume-76dfe14f-749e-47d6-845a-a4dce376e401', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26bd9ad-4f8e-43a0-a500-0bdfb0f8d119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26bd9ad-4f8e-43a0-a500-0bdfb0f8d119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d870c91-b1ec-44ec-b347-ae7045af2daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Volume 76dfe14f-749e-47d6-845a-a4dce376e401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76dfe14f-749e-47d6-845a-a4dce376e401', 'volume_size': 1} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:19 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.info" returned: 0 in 0.247s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-39319917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9694b7c-c186-4772-9648-2ecd183f7319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:19Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Creating volume a9694b7c-c186-4772-9648-2ecd183f7319 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:19 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:19 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 1073741824 Sep 29 12:02:19 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fc83e4bf-76ea-4533-ae43-73579bbbf9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Create snapshot completed successfully Sep 29 12:02:20 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 1073741824" returned: 0 in 0.460s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:20 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 Sep 29 12:02:20 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:20 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319" returned: 0 in 0.323s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1907492729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6befca-befc-48e2-925a-01cdd5f5f251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbab6581cad947e2a4bc54ea28e8667f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:19Z,use_quota=True,user_id='dace4f34db8d472c9754056063d46629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Creating volume 6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:20 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:20 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 1073741824 Sep 29 12:02:20 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186045fe-b92d-4b97-96e8-10aeda8df50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9694b7c-c186-4772-9648-2ecd183f7319', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5206b486-ebbd-4613-aeee-e2fe674b435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Volume volume-a9694b7c-c186-4772-9648-2ecd183f7319 (a9694b7c-c186-4772-9648-2ecd183f7319): created successfully Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5206b486-ebbd-4613-aeee-e2fe674b435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (1adea589-ce5f-4680-a005-0f03f7f833ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0dd648cd-f8ac-4208-ad3d-e8607737a588 tempest-VolumesActionsTest-217134331 None] Created volume successfully. Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-a9694b7c-c186-4772-9648-2ecd183f7319-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Lock "cinder-a9694b7c-c186-4772-9648-2ecd183f7319-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:21 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 1073741824" returned: 0 in 0.495s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-quobyte-a9694b7c-c186-4772-9648-2ecd183f7319" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-a9694b7c-c186-4772-9648-2ecd183f7319" acquired by "delete_volume" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:21 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 Sep 29 12:02:21 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc423ac9-cca5-4f92-a411-f9a029cc1b6a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "cinder-2f472c34-900c-4df9-b560-d1896931afbf-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-2f472c34-900c-4df9-b560-d1896931afbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "cinder-quobyte-4319525c-4941-4135-b4bd-d6c2b8551e30" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-quobyte-4319525c-4941-4135-b4bd-d6c2b8551e30" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "cinder-quobyte-2f472c34-900c-4df9-b560-d1896931afbf" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:21 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 Sep 29 12:02:21 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-quobyte-2f472c34-900c-4df9-b560-d1896931afbf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Deleting offline snapshot 2f472c34-900c-4df9-b560-d1896931afbf of volume 4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] snapshot_file for this snap is: volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ee44e-a536-4834-a376-95309f9e1e6c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:21 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.949s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1774259978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76dfe14f-749e-47d6-845a-a4dce376e401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea3ed83d72b4bea8aaf3c7f72e6d1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:20Z,use_quota=True,user_id='5a5d3d43bb1c403abcaab22a21d79113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Creating volume 76dfe14f-749e-47d6-845a-a4dce376e401 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:21 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acaff490-ec64-4f32-aeb8-e73cd341ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6befca-befc-48e2-925a-01cdd5f5f251', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093d0da0-e9e2-46ce-be74-55748f316a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:21 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf Sep 29 12:02:21 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:21 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 1073741824 Sep 29 12:02:21 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:21 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Volume volume-6f6befca-befc-48e2-925a-01cdd5f5f251 (6f6befca-befc-48e2-925a-01cdd5f5f251): created successfully Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093d0da0-e9e2-46ce-be74-55748f316a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Flow 'volume_create_manager' (f14f50ba-4908-4c56-8ec1-d9650d368e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-dff2366c-e366-4cd7-aa01-f209365198a7 tempest-VolumesDeleteCascade-1322930401 None] Created volume successfully. Sep 29 12:02:21 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319" returned: 0 in 0.501s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:21 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319 Sep 29 12:02:21 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:22 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf" returned: 0 in 0.438s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4319525c-4941-4135-b4bd-d6c2b8551e30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32cc035-2f48-44f9-904e-fe3c7db65f2d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:22 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9694b7c-c186-4772-9648-2ecd183f7319" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-a9694b7c-c186-4772-9648-2ecd183f7319" released by "delete_volume" :: held 0.847s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:22 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 Sep 29 12:02:22 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Created reservations ['92e464e5-f1b6-4f00-836b-6cc7321b7277', 'd98841ab-b7be-4acd-91ba-7c4b5e716a7d', '11448bb4-2f87-4456-98df-3a67b4fcd292', 'b9f9738c-77ad-4db6-ab3a-01db41de9180'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:22 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 1073741824" returned: 0 in 0.552s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:22 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 Sep 29 12:02:22 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:22 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:22 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:22 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30" returned: 0 in 0.488s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:22 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:22 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf Sep 29 12:02:22 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401" returned: 0 in 0.319s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d870c91-b1ec-44ec-b347-ae7045af2daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76dfe14f-749e-47d6-845a-a4dce376e401', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c450f62-8296-4f18-9bc9-2de1c5a3d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Volume volume-76dfe14f-749e-47d6-845a-a4dce376e401 (76dfe14f-749e-47d6-845a-a4dce376e401): created successfully Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c450f62-8296-4f18-9bc9-2de1c5a3d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Flow 'volume_create_manager' (9d704ccf-806c-4b34-bc05-79f3dccff500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7530b42c-9a08-4fd8-b5a9-9c9ae4fd8c09 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Created volume successfully. Sep 29 12:02:22 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.434s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Deleted volume successfully. Sep 29 12:02:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e27b77be-adf3-4355-b09e-dc51af253ebd tempest-VolumesActionsTest-1553554182 None] Lock "cinder-a9694b7c-c186-4772-9648-2ecd183f7319-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:23 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf" returned: 0 in 0.468s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:23 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf Sep 29 12:02:23 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Creating offline snapshot 2bd0b7e8-6b5a-4d74-990f-7cbede528302 of volume 6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (22bff988-43ee-4ff2-a7a4-3a153179a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af43274d-097d-4de7-854c-0730d0a1267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f1c0e-2b19-4ec2-b53e-3c5ada1f81fd]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af43274d-097d-4de7-854c-0730d0a1267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-794475210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133642c5-3914-46ef-b63f-cbaaaa3809cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:23Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05027902-6164-4fd2-8605-61a0d709ea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05027902-6164-4fd2-8605-61a0d709ea32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17209e8-ca40-4d75-a637-136aec2233b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17209e8-ca40-4d75-a637-136aec2233b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133642c5-3914-46ef-b63f-cbaaaa3809cf', 'volume_name': 'volume-133642c5-3914-46ef-b63f-cbaaaa3809cf', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc6eff6-5767-4918-8a2e-f8d92efb350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc6eff6-5767-4918-8a2e-f8d92efb350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75645aa0-6755-4eeb-ae8c-89d4e426eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:23 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Volume 133642c5-3914-46ef-b63f-cbaaaa3809cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133642c5-3914-46ef-b63f-cbaaaa3809cf', 'volume_size': 1} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:23 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30.2f472c34-900c-4df9-b560-d1896931afbf" returned: 0 in 0.310s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-quobyte-2f472c34-900c-4df9-b560-d1896931afbf" released by "_delete_snapshot" :: held 1.841s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:23 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-quobyte-4319525c-4941-4135-b4bd-d6c2b8551e30" released by "delete_snapshot" :: held 1.877s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:23 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Created reservations ['e748a53e-c599-443b-a840-91feefc3e592', '676c664e-fab2-4eba-9874-127d8c7dc64c', 'aca37a8b-9df4-45b1-bde6-89a824fdcdd3', '2bf9dc7c-90a5-4605-917e-c1427eb370ea'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:23 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Delete snapshot completed successfully. Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-22aaaac5-0d80-41d2-ac6d-90c907913072 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-2f472c34-900c-4df9-b560-d1896931afbf-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:23 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251" returned: 0 in 0.447s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "cinder-4319525c-4941-4135-b4bd-d6c2b8551e30-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-4319525c-4941-4135-b4bd-d6c2b8551e30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:23 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 1G Sep 29 12:02:23 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "cinder-quobyte-4319525c-4941-4135-b4bd-d6c2b8551e30" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-quobyte-4319525c-4941-4135-b4bd-d6c2b8551e30" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b96f1-7d7f-4b4f-84a2-2c7e3ca6de5c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:24 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 Sep 29 12:02:24 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:24 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 1G" returned: 0 in 0.545s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:24 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 Sep 29 12:02:24 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Acquiring lock "cinder-76dfe14f-749e-47d6-845a-a4dce376e401-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:24 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30" returned: 0 in 0.506s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "cinder-76dfe14f-749e-47d6-845a-a4dce376e401-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:24 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30 Sep 29 12:02:24 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Acquiring lock "cinder-quobyte-76dfe14f-749e-47d6-845a-a4dce376e401" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "cinder-quobyte-76dfe14f-749e-47d6-845a-a4dce376e401" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29beff4-ecb5-44b4-9a59-cfa2ec3823d1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:24 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302" returned: 0 in 0.371s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:24 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 is being set with open permissions: ugo+rw Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:24 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 Sep 29 12:02:24 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:24 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 Sep 29 12:02:24 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:24 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4319525c-4941-4135-b4bd-d6c2b8551e30" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-quobyte-4319525c-4941-4135-b4bd-d6c2b8551e30" released by "delete_volume" :: held 0.920s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Created reservations ['5240521c-d6c1-40b9-86f5-e94fef4f1fa7', '24a2e4da-871c-4dda-91f4-e9807acc440c', '839fccca-1b91-4382-ac19-3150fc39c56f', 'c3ac9571-a459-49d5-89ae-0bb146d8db3c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:24 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:24 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:24 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:25 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401" returned: 0 in 0.472s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:25 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.info Sep 29 12:02:25 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:25 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401 Sep 29 12:02:25 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:25 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Deleted volume successfully. Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6157710a-c13c-4243-b71d-5276dbf06241 tempest-VolumeSnapshotQuotasNegativeTestJSON-1203386554 None] Lock "cinder-4319525c-4941-4135-b4bd-d6c2b8551e30-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:25 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:25 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-76dfe14f-749e-47d6-845a-a4dce376e401" returned: 0 in 0.342s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.info" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:25 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.info is being set with open permissions: ugo+rw Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "cinder-quobyte-76dfe14f-749e-47d6-845a-a4dce376e401" released by "delete_volume" :: held 0.872s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:25 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.info Sep 29 12:02:25 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Created reservations ['dc4a7f1c-9d2f-4572-a089-380bdaf1584f', 'd08f8ef0-8a3b-42ac-aee6-75f6fafdaf1c', 'f5ee20af-6347-40d7-a15e-39baa0415e98', 'd03cee94-e2cd-48f9-9b79-de34f10367c6'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:25 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:25 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:25 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.info" returned: 0 in 0.353s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-794475210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133642c5-3914-46ef-b63f-cbaaaa3809cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:23Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Creating volume 133642c5-3914-46ef-b63f-cbaaaa3809cf {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:25 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:25 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.290s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:25 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf 1073741824 Sep 29 12:02:25 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Deleted volume successfully. Sep 29 12:02:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-80b1c866-564a-46c1-9379-6b796064fe62 tempest-VolumesDeleteCascade-1322930401 None] Create snapshot completed successfully Sep 29 12:02:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-602704e9-515e-4609-9064-3acd28675929 tempest-VolumeQuotasNegativeTestJSON-2015775651 None] Lock "cinder-76dfe14f-749e-47d6-845a-a4dce376e401-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:26 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf 1073741824" returned: 0 in 0.653s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:26 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf Sep 29 12:02:26 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:26 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.298s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75645aa0-6755-4eeb-ae8c-89d4e426eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133642c5-3914-46ef-b63f-cbaaaa3809cf', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4deb032e-5232-462f-a88b-42c1d531a42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Creating offline snapshot fd286261-08a4-4da3-bb26-78dcb918d050 of volume 6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:02:26 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Volume volume-133642c5-3914-46ef-b63f-cbaaaa3809cf (133642c5-3914-46ef-b63f-cbaaaa3809cf): created successfully Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4deb032e-5232-462f-a88b-42c1d531a42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (22bff988-43ee-4ff2-a7a4-3a153179a325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4405e07e-15d7-4ecb-aac8-fa3c1ad992d2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:26 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ae88548e-24d4-4954-a0b7-04318454edf7 tempest-VolumesActionsTest-217134331 None] Created volume successfully. Sep 29 12:02:27 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 Sep 29 12:02:27 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:27 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302" returned: 0 in 0.405s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6befca-befc-48e2-925a-01cdd5f5f251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:27 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 1G Sep 29 12:02:27 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-133642c5-3914-46ef-b63f-cbaaaa3809cf-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-133642c5-3914-46ef-b63f-cbaaaa3809cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Acquiring lock "cinder-quobyte-133642c5-3914-46ef-b63f-cbaaaa3809cf" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-133642c5-3914-46ef-b63f-cbaaaa3809cf" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1e5abd-c30f-4f0c-9473-16dee2c89213]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:27 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 1G" returned: 0 in 0.655s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:27 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf Sep 29 12:02:27 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:27 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 Sep 29 12:02:28 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:28 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050" returned: 0 in 0.369s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:28 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 is being set with open permissions: ugo+rw Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:28 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf" returned: 0 in 0.520s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:28 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 Sep 29 12:02:28 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:28 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf Sep 29 12:02:28 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:28 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-133642c5-3914-46ef-b63f-cbaaaa3809cf" returned: 0 in 0.306s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:28 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050" returned: 0 in 0.351s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-quobyte-133642c5-3914-46ef-b63f-cbaaaa3809cf" released by "delete_volume" :: held 0.899s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d4c28787-75ce-4284-8434-c00d8c6136fe tempest-VolumesDeleteCascade-1322930401 None] Create snapshot completed successfully Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Created reservations ['c21f1128-a94a-4cf1-8996-bc582d2125f3', '52e658df-d478-47bf-a515-45ac758e807d', '76236bf6-6735-4eda-875a-ad50eaf94c8b', 'd8b79a0b-db71-476d-9c43-9cdf930069fe'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:28 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:28 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:29 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.280s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:29 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Deleted volume successfully. Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2f39e490-2939-4146-b761-64812c9595b0 tempest-VolumesActionsTest-1553554182 None] Lock "cinder-133642c5-3914-46ef-b63f-cbaaaa3809cf-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-6f6befca-befc-48e2-925a-01cdd5f5f251-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-6f6befca-befc-48e2-925a-01cdd5f5f251-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Performing cascade delete. {{(pid=86117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-2bd0b7e8-6b5a-4d74-990f-7cbede528302-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-2bd0b7e8-6b5a-4d74-990f-7cbede528302-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-2bd0b7e8-6b5a-4d74-990f-7cbede528302" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-2bd0b7e8-6b5a-4d74-990f-7cbede528302" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Deleting offline snapshot 2bd0b7e8-6b5a-4d74-990f-7cbede528302 of volume 6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] snapshot_file for this snap is: volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715c9f1-0956-451f-824d-3ad296f59c21]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:30 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 Sep 29 12:02:30 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:30 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302" returned: 0 in 0.495s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6befca-befc-48e2-925a-01cdd5f5f251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad69059-86aa-412b-9cbf-e1ad283d74f3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:30 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 Sep 29 12:02:30 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (027a3af8-4074-4345-ae94-736dd67f1ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05233e00-0253-4678-8484-d3c33ec53243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05233e00-0253-4678-8484-d3c33ec53243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1385563319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:31Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d20f182-bfb0-4425-8e33-cf2a02b5ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d20f182-bfb0-4425-8e33-cf2a02b5ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca23b63-9bbd-45bc-8e9a-b0c4c053f560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca23b63-9bbd-45bc-8e9a-b0c4c053f560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb', 'volume_name': 'volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf76d85-1b7f-482a-90f7-7f71c9e17bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf76d85-1b7f-482a-90f7-7f71c9e17bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dfaa7a-b991-48d2-8bc8-888942f365bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Volume 00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb', 'volume_size': 1} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1385563319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f373701eac46df8cab6b8f64aecff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:31Z,use_quota=True,user_id='c55539d7134e4b74b581a230f54c2713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Creating volume 00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:30 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:31 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251" returned: 0 in 0.514s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:31 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb 1073741824 Sep 29 12:02:31 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b38ea6-af17-4bb1-8f11-3d13f6d9454a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:31 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 Sep 29 12:02:31 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:31 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb 1073741824" returned: 0 in 0.544s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:31 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050" returned: 0 in 0.456s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6befca-befc-48e2-925a-01cdd5f5f251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff08c1-3e21-47d5-acf7-3dd2653ec1cf]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:31 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb Sep 29 12:02:31 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:31 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 Sep 29 12:02:31 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:31 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb" returned: 0 in 0.314s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dfaa7a-b991-48d2-8bc8-888942f365bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b74202b-05e0-4351-89a8-a8ef3b1a6b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Volume volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb (00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb): created successfully Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b74202b-05e0-4351-89a8-a8ef3b1a6b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Flow 'volume_create_manager' (027a3af8-4074-4345-ae94-736dd67f1ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f90473ee-cfdb-4186-b944-60cefd1460f6 tempest-VolumesActionsTest-217134331 None] Created volume successfully. Sep 29 12:02:32 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302" returned: 0 in 0.482s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6befca-befc-48e2-925a-01cdd5f5f251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0aba7e-9822-4b06-8466-e706beb16407]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:32 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 Sep 29 12:02:32 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:32 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251" returned: 0 in 0.402s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:32 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 Sep 29 12:02:32 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:32 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302" returned: 0 in 0.500s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:33 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302 Sep 29 12:02:33 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:33 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.2bd0b7e8-6b5a-4d74-990f-7cbede528302" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 -F qcow2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:33 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 -F qcow2 Sep 29 12:02:33 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Acquiring lock "cinder-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Lock "cinder-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Acquiring lock "cinder-quobyte-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Lock "cinder-quobyte-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d437cfa9-fbb1-4581-ac62-1fe7d421c343]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:33 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6befca-befc-48e2-925a-01cdd5f5f251 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 -F qcow2" returned: 0 in 0.474s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:33 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb Sep 29 12:02:33 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-2bd0b7e8-6b5a-4d74-990f-7cbede528302" released by "_delete_snapshot" :: held 3.923s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" released by "delete_snapshot" :: held 3.956s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:33 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Created reservations ['5d09452f-4856-4f7d-a271-d31168fd3b14', 'a76816aa-62cd-4cda-85b5-c932f0d7db4b', 'ebb309c2-1e89-4b41-9972-f0d744b0d46f', '08f55631-a04c-48fc-809f-e278f45f7c1b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Delete snapshot completed successfully. Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-2bd0b7e8-6b5a-4d74-990f-7cbede528302-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-fd286261-08a4-4da3-bb26-78dcb918d050-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-fd286261-08a4-4da3-bb26-78dcb918d050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-fd286261-08a4-4da3-bb26-78dcb918d050" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-fd286261-08a4-4da3-bb26-78dcb918d050" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Deleting offline snapshot fd286261-08a4-4da3-bb26-78dcb918d050 of volume 6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] snapshot_file for this snap is: volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:02:34 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb" returned: 0 in 0.482s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aea3d22-d936-4238-9e95-589e797d4630]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:34 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb Sep 29 12:02:34 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:34 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 Sep 29 12:02:34 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:34 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb" returned: 0 in 0.364s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Lock "cinder-quobyte-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb" released by "delete_volume" :: held 0.925s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Created reservations ['ae3bad9e-3e48-479f-abcb-7c64937b5181', 'a9cb8607-31a2-462c-b21b-13deaf0a5ea5', '6e193a9f-4e0e-4556-a1ef-a03db30aa150', 'e16cdc4e-9a3d-4701-9ab8-ab32951ea6f8'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:34 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050" returned: 0 in 0.580s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6befca-befc-48e2-925a-01cdd5f5f251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb19645-dbd7-493f-a701-8944f9ab4e33]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:34 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:34 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:34 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 Sep 29 12:02:34 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:35 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.298s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Deleted volume successfully. Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-18354408-406c-437c-9950-e75526c425cc tempest-VolumesActionsTest-217134331 None] Lock "cinder-00c37ab1-a941-4e26-bc5e-9a0d5da2e6cb-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:35 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251" returned: 0 in 0.434s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:35 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 Sep 29 12:02:35 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:35 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050" returned: 0 in 0.433s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:35 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050 Sep 29 12:02:35 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:35 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251.fd286261-08a4-4da3-bb26-78dcb918d050" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-fd286261-08a4-4da3-bb26-78dcb918d050" released by "_delete_snapshot" :: held 1.936s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" released by "delete_snapshot" :: held 1.967s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Created reservations ['73a3f630-475a-447f-a1da-6a4e0350ef04', '5ebfa80c-feaf-44e3-8131-4c11d8462665', '586e44bb-7697-4d15-8bc1-32f2e6190de1', '10c5f6bf-68f1-434c-a1c6-6f0054c7734b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:36 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Delete snapshot completed successfully. Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-fd286261-08a4-4da3-bb26-78dcb918d050-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Snapshots deleted, issuing volume delete {{(pid=86117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36abe5b-b14d-4a83-a8ef-1473157384bc]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:36 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 Sep 29 12:02:36 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:36 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251" returned: 0 in 0.472s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:36 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251 Sep 29 12:02:36 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:37 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6f6befca-befc-48e2-925a-01cdd5f5f251" returned: 0 in 0.290s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-6f6befca-befc-48e2-925a-01cdd5f5f251" released by "delete_volume" :: held 0.884s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Created reservations ['0691d774-cb7d-4bff-b001-66210f6a0594', 'af9945ab-f855-40e0-89b7-39d27be83393', '0c3ae7da-403d-47c5-9590-5a7a08356f8e', '1a89bcf0-d556-4bba-bd40-3edfbff061ba'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:37 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:37 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:37 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.409s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:37 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Deleted volume successfully. Sep 29 12:02:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1d90ee48-6630-4bef-a3e1-1ffb33519865 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-6f6befca-befc-48e2-925a-01cdd5f5f251-delete_volume" released by "delete_volume" :: held 8.165s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Flow 'volume_create_manager' (529f7ef8-9e7e-43f3-9687-0f97c2707349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d4b553-27d0-4d77-9fea-3b59242c8ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d4b553-27d0-4d77-9fea-3b59242c8ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1701762954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d1b2ce-0db8-4663-b9fd-52cdb7f937aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbab6581cad947e2a4bc54ea28e8667f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:39Z,use_quota=True,user_id='dace4f34db8d472c9754056063d46629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b33d46f-0a22-45a0-9b76-cea2b3d1a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b33d46f-0a22-45a0-9b76-cea2b3d1a848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e86775-3be8-48a6-9411-d9fae83ab042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e86775-3be8-48a6-9411-d9fae83ab042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d1b2ce-0db8-4663-b9fd-52cdb7f937aa', 'volume_name': 'volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c263837-a3d0-46a3-ac06-b3512a10e69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c263837-a3d0-46a3-ac06-b3512a10e69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dc01cd-3d75-4ab1-b0c5-146364f11e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:38 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Volume 05d1b2ce-0db8-4663-b9fd-52cdb7f937aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa', 'volume_size': 1} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1701762954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d1b2ce-0db8-4663-b9fd-52cdb7f937aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbab6581cad947e2a4bc54ea28e8667f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:39Z,use_quota=True,user_id='dace4f34db8d472c9754056063d46629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Creating volume 05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:38 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:38 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa 1073741824 Sep 29 12:02:38 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:39 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa 1073741824" returned: 0 in 0.618s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:39 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa Sep 29 12:02:39 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:39 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dc01cd-3d75-4ab1-b0c5-146364f11e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5a7297-7356-4a63-961c-3ee69eb54ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:39 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Volume volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa (05d1b2ce-0db8-4663-b9fd-52cdb7f937aa): created successfully Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5a7297-7356-4a63-961c-3ee69eb54ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Flow 'volume_create_manager' (529f7ef8-9e7e-43f3-9687-0f97c2707349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8948ad37-0c68-4a30-a348-faf48e428744 tempest-VolumesDeleteCascade-1322930401 None] Created volume successfully. Sep 29 12:02:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Creating offline snapshot a1cb00a1-d640-488e-9df6-a84e01f15b29 of volume 05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a8a87b-a3ac-42fe-a74a-0220821ec35c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:41 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa Sep 29 12:02:41 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Flow 'volume_create_manager' (2a811ba9-1b60-404a-a4b6-653367847b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70339a25-d5b4-4ceb-9d97-b748ddd08926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70339a25-d5b4-4ceb-9d97-b748ddd08926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-229186499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7c4917-d5b5-405b-b14f-cbae010007a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441657c094314089801d716dfd7e70eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:41Z,use_quota=True,user_id='4a09cb376f774c659cbd38a721b8a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bca4d82-ebba-41bb-9b7c-f73769ecbf43),volume_type_id=7bca4d82-ebba-41bb-9b7c-f73769ecbf43)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b25a3-c6ad-416b-ba2e-473a3acc9fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b25a3-c6ad-416b-ba2e-473a3acc9fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a9119a-be50-4b77-abda-6889bfa9a544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a9119a-be50-4b77-abda-6889bfa9a544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7c4917-d5b5-405b-b14f-cbae010007a5', 'volume_name': 'volume-7f7c4917-d5b5-405b-b14f-cbae010007a5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7694909f-11d1-44ab-a3de-e0891c76f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7694909f-11d1-44ab-a3de-e0891c76f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348dff45-35de-4a5f-8636-debcc4ece90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:41 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Volume 7f7c4917-d5b5-405b-b14f-cbae010007a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7c4917-d5b5-405b-b14f-cbae010007a5', 'volume_size': 1} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:41 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" returned: 0 in 0.603s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:41 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 1G Sep 29 12:02:41 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:42 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 1G" returned: 0 in 0.470s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:42 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 Sep 29 12:02:42 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:42 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29" returned: 0 in 0.355s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:42 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 is being set with open permissions: ugo+rw Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:42 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 Sep 29 12:02:42 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:42 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29" returned: 0 in 0.292s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:42 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.info Sep 29 12:02:42 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Flow 'volume_create_manager' (35aa2ebd-2017-4453-99f2-64d22e0ba2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572c0bcf-eae2-4c07-bab5-6f9f636f96d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572c0bcf-eae2-4c07-bab5-6f9f636f96d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-358379857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ac3460-adbb-4385-9b00-647f47f1f868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d0cc0a7f084a169dde7cdd3d4477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:43Z,use_quota=True,user_id='f7d35ca5e95e48ec89ec7f43fc691b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d9c150-45ba-47d0-b939-393e02016cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d9c150-45ba-47d0-b939-393e02016cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35dfca4-94bb-436c-9fcd-d6a5be449098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35dfca4-94bb-436c-9fcd-d6a5be449098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ac3460-adbb-4385-9b00-647f47f1f868', 'volume_name': 'volume-47ac3460-adbb-4385-9b00-647f47f1f868', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a65bf2-c01b-4ff1-aa6c-f2d74b1cbcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a65bf2-c01b-4ff1-aa6c-f2d74b1cbcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7f335b-e9f6-4c11-8516-38cb3763a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:43 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Volume 47ac3460-adbb-4385-9b00-647f47f1f868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ac3460-adbb-4385-9b00-647f47f1f868', 'volume_size': 1} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:43 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.info" returned: 0 in 0.287s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:43 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.info is being set with open permissions: ugo+rw Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:43 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.info Sep 29 12:02:43 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:43 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.info" returned: 0 in 0.273s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-229186499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7c4917-d5b5-405b-b14f-cbae010007a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441657c094314089801d716dfd7e70eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:41Z,use_quota=True,user_id='4a09cb376f774c659cbd38a721b8a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bca4d82-ebba-41bb-9b7c-f73769ecbf43),volume_type_id=7bca4d82-ebba-41bb-9b7c-f73769ecbf43)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Creating volume 7f7c4917-d5b5-405b-b14f-cbae010007a5 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:43 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:43 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 1073741824 Sep 29 12:02:43 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1b3af043-c38c-4cc0-a328-24783a68ef46 tempest-VolumesDeleteCascade-1322930401 None] Create snapshot completed successfully Sep 29 12:02:43 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 1073741824" returned: 0 in 0.423s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:43 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 Sep 29 12:02:43 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:44 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5" returned: 0 in 0.278s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-358379857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ac3460-adbb-4385-9b00-647f47f1f868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d0cc0a7f084a169dde7cdd3d4477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:43Z,use_quota=True,user_id='f7d35ca5e95e48ec89ec7f43fc691b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Creating volume 47ac3460-adbb-4385-9b00-647f47f1f868 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:44 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:44 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 1073741824 Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348dff45-35de-4a5f-8636-debcc4ece90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7c4917-d5b5-405b-b14f-cbae010007a5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:44 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf51d14f-4c5d-452a-83e9-dd50b54e8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:44 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Volume volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 (7f7c4917-d5b5-405b-b14f-cbae010007a5): created successfully Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf51d14f-4c5d-452a-83e9-dd50b54e8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Flow 'volume_create_manager' (2a811ba9-1b60-404a-a4b6-653367847b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d150613a-7c8d-4753-9f52-e1da22a5aa24 tempest-VolumeTypesAccessTest-242131058 None] Created volume successfully. Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Acquiring lock "cinder-7f7c4917-d5b5-405b-b14f-cbae010007a5-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Lock "cinder-7f7c4917-d5b5-405b-b14f-cbae010007a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Acquiring lock "cinder-quobyte-7f7c4917-d5b5-405b-b14f-cbae010007a5" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Lock "cinder-quobyte-7f7c4917-d5b5-405b-b14f-cbae010007a5" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa78603a-57d7-49f2-b883-f73ab7ee015d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:44 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 1073741824" returned: 0 in 0.601s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:44 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 Sep 29 12:02:44 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 Sep 29 12:02:44 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:44 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Flow 'volume_create_manager' (3db21c08-e979-45fd-9213-1ebae5ea1228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1803e235-04af-487b-bec2-cc9f87b77e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1803e235-04af-487b-bec2-cc9f87b77e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1298284379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df21718-4ba3-4611-b57a-fed55b7305ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbab6581cad947e2a4bc54ea28e8667f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1cb00a1-d640-488e-9df6-a84e01f15b29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:45Z,use_quota=True,user_id='dace4f34db8d472c9754056063d46629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374b867f-4569-4414-b35e-fe2e9920dbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374b867f-4569-4414-b35e-fe2e9920dbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29270bf3-1167-4912-a13e-1a3537cf7bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29270bf3-1167-4912-a13e-1a3537cf7bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8df21718-4ba3-4611-b57a-fed55b7305ef', 'volume_name': 'volume-8df21718-4ba3-4611-b57a-fed55b7305ef', 'volume_size': 1, 'snapshot_id': 'a1cb00a1-d640-488e-9df6-a84e01f15b29'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b6966b-951c-4745-a9e5-501aecbc7f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b6966b-951c-4745-a9e5-501aecbc7f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc27520-8b6f-44e9-b7d9-b7cca12155b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:44 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Volume 8df21718-4ba3-4611-b57a-fed55b7305ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8df21718-4ba3-4611-b57a-fed55b7305ef', 'volume_size': 1, 'snapshot_id': 'a1cb00a1-d640-488e-9df6-a84e01f15b29'} Sep 29 12:02:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:45 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868" returned: 0 in 0.292s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.109s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-a1cb00a1-d640-488e-9df6-a84e01f15b29-8df21718-4ba3-4611-b57a-fed55b7305ef" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7f335b-e9f6-4c11-8516-38cb3763a60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ac3460-adbb-4385-9b00-647f47f1f868', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776390d6-5254-4998-9af6-10ec3204f5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:45 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5" returned: 0 in 0.427s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-a1cb00a1-d640-488e-9df6-a84e01f15b29-8df21718-4ba3-4611-b57a-fed55b7305ef" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Creating volume 8df21718-4ba3-4611-b57a-fed55b7305ef from snapshot a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-8df21718-4ba3-4611-b57a-fed55b7305ef" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:45 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5 Sep 29 12:02:45 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:45 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Volume volume-47ac3460-adbb-4385-9b00-647f47f1f868 (47ac3460-adbb-4385-9b00-647f47f1f868): created successfully Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776390d6-5254-4998-9af6-10ec3204f5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Flow 'volume_create_manager' (35aa2ebd-2017-4453-99f2-64d22e0ba2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-8df21718-4ba3-4611-b57a-fed55b7305ef" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] snapshot: a1cb00a1-d640-488e-9df6-a84e01f15b29, volume: 8df21718-4ba3-4611-b57a-fed55b7305ef, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:02:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-25d611f4-a5fd-4777-b3f6-7f45400ddd2b tempest-VolumesTransfersTest-1474737161 None] Created volume successfully. Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[202e120b-d14d-464e-8704-041eac124136]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:45 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7f7c4917-d5b5-405b-b14f-cbae010007a5" returned: 0 in 0.401s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:45 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 Sep 29 12:02:45 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Lock "cinder-quobyte-7f7c4917-d5b5-405b-b14f-cbae010007a5" released by "delete_volume" :: held 0.882s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:45 devstack cinder-volume[86117]: WARNING cinder.quota [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1639444660 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1639444660, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:02:45 devstack cinder-volume[86117]: WARNING cinder.quota [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1639444660 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1639444660, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Created reservations ['e94e9955-34a3-4589-bf7c-c3c165f90786', '87c39cac-7531-42a1-b13d-f325154b725c', '1ca1337d-ca9a-41bd-b119-52a632dfcd5a', 'ae943ddc-83ee-4b3b-8535-86e5a68ba35d'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:45 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:45 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:45 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29" returned: 0 in 0.526s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e445a2-148e-4902-9907-066c14aad9aa]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:46 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.347s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:46 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Deleted volume successfully. Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-be66d06e-9801-4832-8c20-d5b4d061b13b tempest-VolumeTypesAccessTest-242131058 None] Lock "cinder-7f7c4917-d5b5-405b-b14f-cbae010007a5-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:46 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa Sep 29 12:02:46 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:46 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" returned: 0 in 0.581s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:02:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:46 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef Sep 29 12:02:46 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:47 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6f69206d-90a9-46e5-95c3-9027db895760 tempest-VolumesTransfersTest-107740075 None] Transfer volume completed successfully. Sep 29 12:02:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Acquiring lock "cinder-47ac3460-adbb-4385-9b00-647f47f1f868-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-47ac3460-adbb-4385-9b00-647f47f1f868-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Acquiring lock "cinder-quobyte-47ac3460-adbb-4385-9b00-647f47f1f868" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-quobyte-47ac3460-adbb-4385-9b00-647f47f1f868" acquired by "delete_volume" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:49 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad95401-a372-441a-b8ef-aeb99aeaca45]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:49 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 Sep 29 12:02:49 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:50 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868" returned: 0 in 0.835s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:50 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868 Sep 29 12:02:50 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:50 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-47ac3460-adbb-4385-9b00-647f47f1f868" returned: 0 in 0.755s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-quobyte-47ac3460-adbb-4385-9b00-647f47f1f868" released by "delete_volume" :: held 1.722s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Created reservations ['8a979274-3dc0-4db3-8cf0-95c3a4f7d0b9', '6d3f309e-cc31-4b3a-82a4-28b2539d4646', '5e6f0aaf-e095-4324-8af9-accf2dfa3b2a', '233c8185-7951-4413-bed6-c50fba0268c7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:51 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:51 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:51 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.624s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:02:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Deleted volume successfully. Sep 29 12:02:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5af97a23-df0f-4a85-aa94-52371acbf44d tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-47ac3460-adbb-4385-9b00-647f47f1f868-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Flow 'volume_create_manager' (05226ea7-896b-435d-848e-2bfb02b853a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be596ff7-dcc9-40bc-b3a9-40012a4959e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be596ff7-dcc9-40bc-b3a9-40012a4959e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-706407561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1369800-e970-4bd7-87f2-3355367ac6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d0cc0a7f084a169dde7cdd3d4477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:53Z,use_quota=True,user_id='f7d35ca5e95e48ec89ec7f43fc691b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fc2386-200d-4e30-914d-be4119b4d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fc2386-200d-4e30-914d-be4119b4d29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec9c7f1-ee1c-4ca5-b99e-1c7d49943f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec9c7f1-ee1c-4ca5-b99e-1c7d49943f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1369800-e970-4bd7-87f2-3355367ac6a8', 'volume_name': 'volume-a1369800-e970-4bd7-87f2-3355367ac6a8', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ee06cf-e11b-4695-a807-4f4aba80d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ee06cf-e11b-4695-a807-4f4aba80d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401ec558-526f-4d84-b1b1-ab2958bc5652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Volume a1369800-e970-4bd7-87f2-3355367ac6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1369800-e970-4bd7-87f2-3355367ac6a8', 'volume_size': 1} Sep 29 12:02:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef" returned: 0 in 9.191s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:55 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa, size 1024.00 MB, duration 9.19 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:02:55 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Converted 1024.00 MB image at 111.41 MB/s Sep 29 12:02:55 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef is being set with open permissions: ugo+rw Sep 29 12:02:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:55 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef Sep 29 12:02:55 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:56 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-8df21718-4ba3-4611-b57a-fed55b7305ef" released by "_copy_volume_from_snapshot" :: held 10.817s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-a1cb00a1-d640-488e-9df6-a84e01f15b29-8df21718-4ba3-4611-b57a-fed55b7305ef" released by "_create_volume_from_snapshot" :: held 10.917s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.965s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.073s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-706407561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1369800-e970-4bd7-87f2-3355367ac6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d0cc0a7f084a169dde7cdd3d4477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:02:53Z,use_quota=True,user_id='f7d35ca5e95e48ec89ec7f43fc691b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Creating volume a1369800-e970-4bd7-87f2-3355367ac6a8 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:02:56 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:56 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 1073741824 Sep 29 12:02:56 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc27520-8b6f-44e9-b7d9-b7cca12155b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df21718-4ba3-4611-b57a-fed55b7305ef', 'volume_size': 1, 'snapshot_id': 'a1cb00a1-d640-488e-9df6-a84e01f15b29'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2e02c0-53da-4ac1-98fc-5744c4f3e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:56 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Volume volume-8df21718-4ba3-4611-b57a-fed55b7305ef (8df21718-4ba3-4611-b57a-fed55b7305ef): created successfully Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2e02c0-53da-4ac1-98fc-5744c4f3e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Flow 'volume_create_manager' (3db21c08-e979-45fd-9213-1ebae5ea1228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:56 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7341f5c0-60a2-4390-a5dc-148ab4a128a8 tempest-VolumesDeleteCascade-1322930401 None] Created volume successfully. Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Performing cascade delete. {{(pid=86117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-a1cb00a1-d640-488e-9df6-a84e01f15b29-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-a1cb00a1-d640-488e-9df6-a84e01f15b29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-a1cb00a1-d640-488e-9df6-a84e01f15b29" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-a1cb00a1-d640-488e-9df6-a84e01f15b29" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Deleting offline snapshot a1cb00a1-d640-488e-9df6-a84e01f15b29 of volume 05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] snapshot_file for this snap is: volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[657feed4-7724-444a-af58-64feddbff9f1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:56 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 1073741824" returned: 0 in 0.651s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:56 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 Sep 29 12:02:56 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:56 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 Sep 29 12:02:56 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:57 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8" returned: 0 in 0.328s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401ec558-526f-4d84-b1b1-ab2958bc5652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1369800-e970-4bd7-87f2-3355367ac6a8', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ced59e-ab8c-4721-ab2a-be96e7204f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:02:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Volume volume-a1369800-e970-4bd7-87f2-3355367ac6a8 (a1369800-e970-4bd7-87f2-3355367ac6a8): created successfully Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ced59e-ab8c-4721-ab2a-be96e7204f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Flow 'volume_create_manager' (05226ea7-896b-435d-848e-2bfb02b853a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:02:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-531e0e78-9f5b-41f3-88df-17a3b6ae8c05 tempest-VolumesTransfersTest-1474737161 None] Created volume successfully. Sep 29 12:02:57 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29" returned: 0 in 0.541s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7f49ea-cb5e-4666-b6da-eeff36dc6e51]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:57 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa Sep 29 12:02:57 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:57 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" returned: 0 in 0.533s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:57 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 Sep 29 12:02:57 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:58 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29" returned: 0 in 0.385s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:58 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29 Sep 29 12:02:58 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:58 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa.a1cb00a1-d640-488e-9df6-a84e01f15b29" returned: 0 in 0.327s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-a1cb00a1-d640-488e-9df6-a84e01f15b29" released by "_delete_snapshot" :: held 1.928s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" released by "delete_snapshot" :: held 1.957s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Created reservations ['effb8703-881c-4b28-88cd-30e3e0dbdb0d', 'fab99762-b5f0-4a05-a687-d82711d9bfe2', '9987a4c0-4698-44a0-851f-3e1e423071b2', '35d8ef15-236a-4aa4-9a60-be43bdff1ee8'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Delete snapshot completed successfully. Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-a1cb00a1-d640-488e-9df6-a84e01f15b29-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Snapshots deleted, issuing volume delete {{(pid=86117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Acquiring lock "cinder-a1369800-e970-4bd7-87f2-3355367ac6a8-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c65d2e4-a4f5-43f3-9d86-eadc1a746270]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-a1369800-e970-4bd7-87f2-3355367ac6a8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Acquiring lock "cinder-quobyte-a1369800-e970-4bd7-87f2-3355367ac6a8" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-quobyte-a1369800-e970-4bd7-87f2-3355367ac6a8" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:02:58 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa Sep 29 12:02:58 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6568992e-687a-4f0b-b2d3-7ef0dc7ecb46]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:59 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 Sep 29 12:02:59 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:59 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" returned: 0 in 0.435s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:59 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa Sep 29 12:02:59 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:59 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8" returned: 0 in 0.474s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:59 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8 Sep 29 12:02:59 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:59 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" returned: 0 in 0.307s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa" released by "delete_volume" :: held 0.837s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Created reservations ['913bce31-cf7c-45b4-a124-5ecfd243a17d', '415922e6-9838-4559-a373-3db991803e0b', 'c64f6a90-9efb-4c71-a824-ea5262e4b171', 'e16a37b0-8e03-452d-bbae-4ec0e8a7d22b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:02:59 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a1369800-e970-4bd7-87f2-3355367ac6a8" returned: 0 in 0.329s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:02:59 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:02:59 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-quobyte-a1369800-e970-4bd7-87f2-3355367ac6a8" released by "delete_volume" :: held 0.877s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Created reservations ['bad5ba45-9118-4a5a-a973-4f34fe9055bd', 'ea8787fa-eb7f-4dc7-add5-eeec68161508', '2c143f46-4ffe-48d4-acee-221da5c168ef', '431fdd55-9588-4b97-88f0-10326fc9e1d3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:02:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:00 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:00 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-8df21718-4ba3-4611-b57a-fed55b7305ef-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:00 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-8df21718-4ba3-4611-b57a-fed55b7305ef-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.469s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Deleted volume successfully. Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f225d0e9-e45b-4c39-9c6e-98362daa11e7 tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-05d1b2ce-0db8-4663-b9fd-52cdb7f937aa-delete_volume" released by "delete_volume" :: held 3.844s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "cinder-quobyte-8df21718-4ba3-4611-b57a-fed55b7305ef" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:00 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.380s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-8df21718-4ba3-4611-b57a-fed55b7305ef" acquired by "delete_volume" :: waited 0.050s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Deleted volume successfully. Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[05817710-c670-4b8c-bbc5-a726f2659b86]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5c0ccf71-18b7-450c-9d66-52a5acd956d3 tempest-VolumesTransfersTest-1421117170 None] Lock "cinder-a1369800-e970-4bd7-87f2-3355367ac6a8-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:00 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef Sep 29 12:03:00 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Flow 'volume_create_manager' (4fcfcac4-1ff0-4cf1-a79d-34dea62a9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc442be-b09d-4325-afe6-3a5a83a55eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc442be-b09d-4325-afe6-3a5a83a55eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1007608659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f869bd14-1e03-4df3-9fca-21ee77183412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcd7275ae0b4c73b67c0c3794d0fa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:01Z,use_quota=True,user_id='1ea48590eecb43acaac075aaad4efa89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c031ad6-3df0-48b3-a88b-2406e80f8d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c031ad6-3df0-48b3-a88b-2406e80f8d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ff3576-8dea-4ebf-b65d-e702c5cb18cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ff3576-8dea-4ebf-b65d-e702c5cb18cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f869bd14-1e03-4df3-9fca-21ee77183412', 'volume_name': 'volume-f869bd14-1e03-4df3-9fca-21ee77183412', 'volume_size': 2}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea08fb1-e89a-46f9-a36b-fb2cd8b5c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea08fb1-e89a-46f9-a36b-fb2cd8b5c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5851c617-4ba5-4c21-882c-4a783f6e3b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Volume f869bd14-1e03-4df3-9fca-21ee77183412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f869bd14-1e03-4df3-9fca-21ee77183412', 'volume_size': 2} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1007608659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f869bd14-1e03-4df3-9fca-21ee77183412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcd7275ae0b4c73b67c0c3794d0fa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:01Z,use_quota=True,user_id='1ea48590eecb43acaac075aaad4efa89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Creating volume f869bd14-1e03-4df3-9fca-21ee77183412 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:00 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 2147483648 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:00 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 2147483648 Sep 29 12:03:00 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:00 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef" returned: 0 in 0.475s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:00 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef Sep 29 12:03:00 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:01 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8df21718-4ba3-4611-b57a-fed55b7305ef" returned: 0 in 0.351s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-quobyte-8df21718-4ba3-4611-b57a-fed55b7305ef" released by "delete_volume" :: held 0.902s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:01 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 2147483648" returned: 0 in 0.626s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Created reservations ['d3ad4d5b-f981-4cca-9e9a-0d6bfb0b616b', '51371418-88df-4a68-92c0-5412d0ffd14b', '24be2e48-ea71-42b7-961d-b33cd2ee35d7', '2120ff76-55de-4feb-9a3b-4cda4e49b7c2'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:01 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 Sep 29 12:03:01 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:01 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:01 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:01 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412" returned: 0 in 0.344s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5851c617-4ba5-4c21-882c-4a783f6e3b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f869bd14-1e03-4df3-9fca-21ee77183412', 'volume_size': 2}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b053403-1ecb-480d-842c-76f3181322ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:01 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Volume volume-f869bd14-1e03-4df3-9fca-21ee77183412 (f869bd14-1e03-4df3-9fca-21ee77183412): created successfully Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b053403-1ecb-480d-842c-76f3181322ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Flow 'volume_create_manager' (4fcfcac4-1ff0-4cf1-a79d-34dea62a9c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c93b6b23-6258-49bb-9295-726005678d63 tempest-VolumesCloneNegativeTest-201794396 None] Created volume successfully. Sep 29 12:03:01 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.320s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Deleted volume successfully. Sep 29 12:03:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c848e57f-06d4-45c8-8a62-b413ee30804d tempest-VolumesDeleteCascade-1322930401 None] Lock "cinder-8df21718-4ba3-4611-b57a-fed55b7305ef-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Acquiring lock "cinder-f869bd14-1e03-4df3-9fca-21ee77183412-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Lock "cinder-f869bd14-1e03-4df3-9fca-21ee77183412-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Acquiring lock "cinder-quobyte-f869bd14-1e03-4df3-9fca-21ee77183412" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Lock "cinder-quobyte-f869bd14-1e03-4df3-9fca-21ee77183412" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[51703488-69ca-44aa-bbb7-a9430e24f674]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:03 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 Sep 29 12:03:03 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:03 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412" returned: 0 in 0.432s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:03 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412 Sep 29 12:03:03 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:03 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f869bd14-1e03-4df3-9fca-21ee77183412" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Lock "cinder-quobyte-f869bd14-1e03-4df3-9fca-21ee77183412" released by "delete_volume" :: held 0.804s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Created reservations ['16bc2530-ec33-444b-89ce-41acece953e8', 'b16bb884-7aa5-48ad-9796-5b0055724d6a', '85cd9794-4ceb-47f7-90cf-c6a3d964bbd8', 'ab0bf4a9-de6c-4778-9d00-f7bba4a2e465'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:03 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:03 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:04 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:04 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:04 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Deleted volume successfully. Sep 29 12:03:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b0d2d801-630d-40e9-aa21-8500fb9bdfcc tempest-VolumesCloneNegativeTest-201794396 None] Lock "cinder-f869bd14-1e03-4df3-9fca-21ee77183412-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=156,cinder:INSERT=50,cinder:UPDATE=202,cinder:DELETE=14 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:DELETE=21,cinder:SELECT=146,cinder:UPDATE=206,cinder:INSERT=51 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Flow 'volume_create_manager' (486a1c09-021f-4d67-93d8-b42dd4596619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbd0712-1c2e-442b-b800-7d4970a34c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbd0712-1c2e-442b-b800-7d4970a34c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-962437158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e6147-c457-4dab-9522-1048df0d2e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe60245dc1694471a90a75161711ee78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:10Z,use_quota=True,user_id='ad67ef7e163f4d2c9951eb2402978b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca98f8de-f563-48d3-98d6-19a18a2681a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca98f8de-f563-48d3-98d6-19a18a2681a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c486f4f5-85be-445e-85fc-da2808b09e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c486f4f5-85be-445e-85fc-da2808b09e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5e6147-c457-4dab-9522-1048df0d2e2f', 'volume_name': 'volume-4c5e6147-c457-4dab-9522-1048df0d2e2f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6315b122-10fc-4b68-ba50-01574be0ee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6315b122-10fc-4b68-ba50-01574be0ee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c6bbc2-2d96-4b4d-b0b1-0b53a26c6114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Volume 4c5e6147-c457-4dab-9522-1048df0d2e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5e6147-c457-4dab-9522-1048df0d2e2f', 'volume_size': 1} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-962437158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e6147-c457-4dab-9522-1048df0d2e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe60245dc1694471a90a75161711ee78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:10Z,use_quota=True,user_id='ad67ef7e163f4d2c9951eb2402978b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Creating volume 4c5e6147-c457-4dab-9522-1048df0d2e2f {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:10 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:10 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f 1073741824 Sep 29 12:03:10 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (f52dd250-2986-4f78-a08e-a4e9be0cade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d38c94b-36f2-47e1-84fe-474c6bb5e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d38c94b-36f2-47e1-84fe-474c6bb5e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-384710158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e383bf1-7ddd-4e39-96dc-fd238014ebe0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:11Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de1239-8c0c-4e6f-9611-d460842b6f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de1239-8c0c-4e6f-9611-d460842b6f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f352df-66c0-4a11-b99e-b2e02b9b6f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f352df-66c0-4a11-b99e-b2e02b9b6f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e383bf1-7ddd-4e39-96dc-fd238014ebe0', 'volume_name': 'volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75c8a4e-eb3a-411d-aa95-58599f92676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75c8a4e-eb3a-411d-aa95-58599f92676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737ee262-f5de-40cb-9f1e-28f2550bdcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:10 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Volume 7e383bf1-7ddd-4e39-96dc-fd238014ebe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0', 'volume_size': 1} Sep 29 12:03:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:11 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f 1073741824" returned: 0 in 0.604s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:11 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f Sep 29 12:03:11 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Flow 'volume_create_manager' (5bc9b7c9-8978-4d73-a9b3-ed81acdbc1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab48313-16c1-489d-9cb0-bb70fba830bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab48313-16c1-489d-9cb0-bb70fba830bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1229893151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb8e0c9-1d36-4eca-b3a9-14041846512f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0783c8c1b8264854a53aa8a6614a7ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:11Z,use_quota=True,user_id='84705a6c14c844dbb680dc02c213192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628dc7ec-a9c2-450c-8db8-11b22e16e487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628dc7ec-a9c2-450c-8db8-11b22e16e487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e740de8-99ab-49e1-9225-c0a490a7f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e740de8-99ab-49e1-9225-c0a490a7f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb8e0c9-1d36-4eca-b3a9-14041846512f', 'volume_name': 'volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0edc2b4-d721-403d-94f8-03433a26cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0edc2b4-d721-403d-94f8-03433a26cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1b76ed-3482-453c-a293-fcfcd6e8698f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:11 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Volume 3fb8e0c9-1d36-4eca-b3a9-14041846512f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f', 'volume_size': 1} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:11 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f" returned: 0 in 0.305s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-384710158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e383bf1-7ddd-4e39-96dc-fd238014ebe0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:11Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Creating volume 7e383bf1-7ddd-4e39-96dc-fd238014ebe0 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:11 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:11 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 1073741824 Sep 29 12:03:11 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c6bbc2-2d96-4b4d-b0b1-0b53a26c6114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5e6147-c457-4dab-9522-1048df0d2e2f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131e93f0-9460-4ec0-afd5-b99e41ffbf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:11 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Volume volume-4c5e6147-c457-4dab-9522-1048df0d2e2f (4c5e6147-c457-4dab-9522-1048df0d2e2f): created successfully Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131e93f0-9460-4ec0-afd5-b99e41ffbf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Flow 'volume_create_manager' (486a1c09-021f-4d67-93d8-b42dd4596619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-808f2741-f814-49f8-a400-7eea454f3346 tempest-VolumesListAdminTestJSON-761396136 None] Created volume successfully. Sep 29 12:03:11 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 1073741824" returned: 0 in 0.441s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:12 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 Sep 29 12:03:12 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:12 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:12 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:12 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0" returned: 0 in 0.247s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1229893151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb8e0c9-1d36-4eca-b3a9-14041846512f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0783c8c1b8264854a53aa8a6614a7ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:11Z,use_quota=True,user_id='84705a6c14c844dbb680dc02c213192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Creating volume 3fb8e0c9-1d36-4eca-b3a9-14041846512f {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:12 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737ee262-f5de-40cb-9f1e-28f2550bdcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:12 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f 1073741824 Sep 29 12:03:12 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a4d52c-181b-454a-a89a-460b0fa66919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:12 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Volume volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 (7e383bf1-7ddd-4e39-96dc-fd238014ebe0): created successfully Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a4d52c-181b-454a-a89a-460b0fa66919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (f52dd250-2986-4f78-a08e-a4e9be0cade2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:12 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-17ad1f32-eee1-4804-ad7b-23372206eb0d tempest-VolumesGetTest-1261209847 None] Created volume successfully. Sep 29 12:03:12 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.342s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Flow 'volume_create_manager' (0de7502c-1c8a-456e-b4f0-f03bcfdc67db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da04f0f-2a9c-49d7-bc42-39a5529bb98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da04f0f-2a9c-49d7-bc42-39a5529bb98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541444142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295590f9-2a93-48cc-8986-6dd4da55fb65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2661a24ca7fc40c0bb19e590c36bf9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:12Z,use_quota=True,user_id='9be9d8cec3294ab09e1b81cd09f71427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f8287e-bedf-47d7-a303-96ff7e3c3e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f8287e-bedf-47d7-a303-96ff7e3c3e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2552077b-a9b7-42d0-a8cf-1e99e556748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2552077b-a9b7-42d0-a8cf-1e99e556748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295590f9-2a93-48cc-8986-6dd4da55fb65', 'volume_name': 'volume-295590f9-2a93-48cc-8986-6dd4da55fb65', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad660d0-6356-4582-9a29-833a2aab3f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad660d0-6356-4582-9a29-833a2aab3f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4dc0ac-89b5-4e22-88b9-a52c7c4ca853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:12 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Volume 295590f9-2a93-48cc-8986-6dd4da55fb65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295590f9-2a93-48cc-8986-6dd4da55fb65', 'volume_size': 1} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:12 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f 1073741824" returned: 0 in 0.632s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:12 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f Sep 29 12:03:12 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Flow 'volume_create_manager' (cfb93bf3-a849-49aa-8d6a-0f10f9c5bbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95ba7d9-8017-4ecb-9a78-5f3d18048118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f" returned: 0 in 0.289s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541444142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295590f9-2a93-48cc-8986-6dd4da55fb65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2661a24ca7fc40c0bb19e590c36bf9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:12Z,use_quota=True,user_id='9be9d8cec3294ab09e1b81cd09f71427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Creating volume 295590f9-2a93-48cc-8986-6dd4da55fb65 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:13 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95ba7d9-8017-4ecb-9a78-5f3d18048118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-534240377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e46adb-6893-4718-9ce4-808551926b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe60245dc1694471a90a75161711ee78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:13Z,use_quota=True,user_id='ad67ef7e163f4d2c9951eb2402978b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71518f27-7e9d-4937-8025-52c14e67368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71518f27-7e9d-4937-8025-52c14e67368d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 1073741824 Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328bd454-1a31-4637-99e3-a7fc1dfcd274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328bd454-1a31-4637-99e3-a7fc1dfcd274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e46adb-6893-4718-9ce4-808551926b44', 'volume_name': 'volume-65e46adb-6893-4718-9ce4-808551926b44', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badccbab-3a5d-4da8-b01b-7b7109534910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badccbab-3a5d-4da8-b01b-7b7109534910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab889443-02c4-4afe-9ee8-2c276f07a175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Volume 65e46adb-6893-4718-9ce4-808551926b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e46adb-6893-4718-9ce4-808551926b44', 'volume_size': 1} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1b76ed-3482-453c-a293-fcfcd6e8698f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab55a95-90cf-4840-9eaf-8118175fa517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Volume volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f (3fb8e0c9-1d36-4eca-b3a9-14041846512f): created successfully Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab55a95-90cf-4840-9eaf-8118175fa517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Flow 'volume_create_manager' (5bc9b7c9-8978-4d73-a9b3-ed81acdbc1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-53c476a5-70d4-4e77-9488-7b662c254aaf tempest-VolumesTransfersV357Test-2092923795 None] Created volume successfully. Sep 29 12:03:13 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 1073741824" returned: 0 in 0.556s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:13 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 Sep 29 12:03:13 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (5c3cc89e-e8f2-4a1e-8632-c2685eeaf72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253a99a1-a5df-47b3-b920-02ddc5291db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253a99a1-a5df-47b3-b920-02ddc5291db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2001311367',display_name='tempest-VolumesGetTest-Volume-1348040052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:14Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ed5763-3f0e-4c98-adea-bb8632b873b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ed5763-3f0e-4c98-adea-bb8632b873b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45889afd-4b6d-45d5-a366-7a8adfd53188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45889afd-4b6d-45d5-a366-7a8adfd53188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34cd2a8-f0ef-483b-98a9-c33bb98ce4b3', 'volume_name': 'volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ec2adc-d6c3-4a32-b15e-7309bc331a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ec2adc-d6c3-4a32-b15e-7309bc331a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c392546-5e2c-4b12-b6f8-adb2278363a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Volume d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3', 'volume_size': 1} Sep 29 12:03:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:14 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-534240377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e46adb-6893-4718-9ce4-808551926b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe60245dc1694471a90a75161711ee78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:13Z,use_quota=True,user_id='ad67ef7e163f4d2c9951eb2402978b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Creating volume 65e46adb-6893-4718-9ce4-808551926b44 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:14 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4dc0ac-89b5-4e22-88b9-a52c7c4ca853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295590f9-2a93-48cc-8986-6dd4da55fb65', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:14 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 1073741824 Sep 29 12:03:14 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46adaf6-80bc-45ac-815f-4e8d6b8cb5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:14 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Volume volume-295590f9-2a93-48cc-8986-6dd4da55fb65 (295590f9-2a93-48cc-8986-6dd4da55fb65): created successfully Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46adaf6-80bc-45ac-815f-4e8d6b8cb5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Flow 'volume_create_manager' (0de7502c-1c8a-456e-b4f0-f03bcfdc67db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:14 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ef8a6ded-4024-4afa-9184-dfd222ef81ab tempest-VolumesTransfersV355Test-2112559784 None] Created volume successfully. Sep 29 12:03:14 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8f03cf71-bcda-437d-9b2f-9f26655d9a91 tempest-VolumesTransfersV357Test-72390467 None] Transfer volume completed successfully. Sep 29 12:03:14 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 1073741824" returned: 0 in 0.556s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:14 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 Sep 29 12:03:14 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:15 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44" returned: 0 in 0.277s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2001311367',display_name='tempest-VolumesGetTest-Volume-1348040052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:14Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Creating volume d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:15 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab889443-02c4-4afe-9ee8-2c276f07a175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e46adb-6893-4718-9ce4-808551926b44', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2db33db-c368-4378-8cb6-de175b80761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:15 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 1073741824 Sep 29 12:03:15 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:15 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Volume volume-65e46adb-6893-4718-9ce4-808551926b44 (65e46adb-6893-4718-9ce4-808551926b44): created successfully Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2db33db-c368-4378-8cb6-de175b80761e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Flow 'volume_create_manager' (cfb93bf3-a849-49aa-8d6a-0f10f9c5bbf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:15 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bc091c39-afe5-4d61-8dfb-77cf502a6177 tempest-VolumesListAdminTestJSON-761396136 None] Created volume successfully. Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Acquiring lock "cinder-3fb8e0c9-1d36-4eca-b3a9-14041846512f-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-3fb8e0c9-1d36-4eca-b3a9-14041846512f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Acquiring lock "cinder-quobyte-3fb8e0c9-1d36-4eca-b3a9-14041846512f" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-quobyte-3fb8e0c9-1d36-4eca-b3a9-14041846512f" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4c3e5-2576-45e7-8a94-14ab1f4a89e1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:15 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f Sep 29 12:03:15 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:15 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ff063543-095f-43c6-ae06-deaf4cbe6e2b tempest-VolumesTransfersV355Test-2122060025 None] Transfer volume completed successfully. Sep 29 12:03:15 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 1073741824" returned: 0 in 0.639s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:15 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 Sep 29 12:03:15 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:15 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f" returned: 0 in 0.493s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:15 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f Sep 29 12:03:15 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:16 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c392546-5e2c-4b12-b6f8-adb2278363a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad327e2-0a29-4d5e-822a-2dac1c9da6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Volume volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 (d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3): created successfully Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad327e2-0a29-4d5e-822a-2dac1c9da6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (5c3cc89e-e8f2-4a1e-8632-c2685eeaf72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:16 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-732ab77c-867d-44c3-8132-4381e120a4c3 tempest-VolumesGetTest-1261209847 None] Created volume successfully. Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fb8e0c9-1d36-4eca-b3a9-14041846512f" returned: 0 in 0.361s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Flow 'volume_create_manager' (35fdcce3-eae9-4355-8d6c-2b1c78a5c86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6843f56a-3c0a-4e65-a24e-7a2c6d462010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-quobyte-3fb8e0c9-1d36-4eca-b3a9-14041846512f" released by "delete_volume" :: held 0.957s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6843f56a-3c0a-4e65-a24e-7a2c6d462010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2109763214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce875291-6eb7-4e31-b14c-09c4c50b7775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe60245dc1694471a90a75161711ee78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:16Z,use_quota=True,user_id='ad67ef7e163f4d2c9951eb2402978b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ab72e6-060f-494d-8be5-b4ba4c853295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ab72e6-060f-494d-8be5-b4ba4c853295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23e86f1-6bcc-466a-ab1d-27f8fb88cd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23e86f1-6bcc-466a-ab1d-27f8fb88cd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce875291-6eb7-4e31-b14c-09c4c50b7775', 'volume_name': 'volume-ce875291-6eb7-4e31-b14c-09c4c50b7775', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cc7a2f-7298-4d39-b686-bea1ff945296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cc7a2f-7298-4d39-b686-bea1ff945296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2cae84-119c-4f77-9d88-28e7f537740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Volume ce875291-6eb7-4e31-b14c-09c4c50b7775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce875291-6eb7-4e31-b14c-09c4c50b7775', 'volume_size': 1} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2109763214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce875291-6eb7-4e31-b14c-09c4c50b7775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe60245dc1694471a90a75161711ee78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:16Z,use_quota=True,user_id='ad67ef7e163f4d2c9951eb2402978b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Creating volume ce875291-6eb7-4e31-b14c-09c4c50b7775 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:16 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Acquiring lock "cinder-295590f9-2a93-48cc-8986-6dd4da55fb65-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:16 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 1073741824 Sep 29 12:03:16 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-295590f9-2a93-48cc-8986-6dd4da55fb65-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Created reservations ['b4cdaabd-9e28-4dce-ae17-9e84d63ab527', '21c65cc8-605a-49a8-9d97-a51c5601af25', 'da7dc423-ceae-4406-a03c-c08434a35133', 'ae9a3166-75e2-4c1e-93d7-fcd1af98abf0'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Acquiring lock "cinder-quobyte-295590f9-2a93-48cc-8986-6dd4da55fb65" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-quobyte-295590f9-2a93-48cc-8986-6dd4da55fb65" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ba586f-e800-4a6c-84b7-652fdd3d8a5e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:16 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:16 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:16 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 Sep 29 12:03:16 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:16 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.251s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Deleted volume successfully. Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f216cb1b-e6bb-4b72-bfe8-ddca63c69607 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-3fb8e0c9-1d36-4eca-b3a9-14041846512f-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:16 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 1073741824" returned: 0 in 0.478s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:16 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 Sep 29 12:03:16 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:16 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65" returned: 0 in 0.422s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:16 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65 Sep 29 12:03:16 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775" returned: 0 in 0.263s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:17 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2cae84-119c-4f77-9d88-28e7f537740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce875291-6eb7-4e31-b14c-09c4c50b7775', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3fbd0c-c6cd-4342-b26b-b6fd7817d1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Volume volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 (ce875291-6eb7-4e31-b14c-09c4c50b7775): created successfully Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3fbd0c-c6cd-4342-b26b-b6fd7817d1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Flow 'volume_create_manager' (35fdcce3-eae9-4355-8d6c-2b1c78a5c86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:17 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-295590f9-2a93-48cc-8986-6dd4da55fb65" returned: 0 in 0.285s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f006dcb0-cc8c-4fb4-b5bd-b785a8901b66 tempest-VolumesListAdminTestJSON-761396136 None] Created volume successfully. Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-quobyte-295590f9-2a93-48cc-8986-6dd4da55fb65" released by "delete_volume" :: held 0.752s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Created reservations ['74813970-1709-4610-85c3-4f100ce121e4', '187ffe49-52b7-48e6-98e5-468bbbc55ff4', 'b22d6a1d-d335-4147-95bb-748adab37c97', 'a95051a2-5e7b-453d-9aec-d858e11bd662'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:17 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:17 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Lock "cinder-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a4512-ea31-4a88-98b1-80499f0eaf5d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:17 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 Sep 29 12:03:17 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:17 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.322s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Deleted volume successfully. Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e99c6631-0402-4a57-877c-9a20ba1ff139 tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-295590f9-2a93-48cc-8986-6dd4da55fb65-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:17 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3" returned: 0 in 0.391s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:17 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3 Sep 29 12:03:17 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:18 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3" returned: 0 in 0.271s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3" released by "delete_volume" :: held 0.748s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Created reservations ['66dd4959-9eca-4fdc-a480-864a6345ed3c', 'b9912314-502d-4a21-9eef-152027fc1f0b', '43a2bb9c-a002-4d70-b226-e3f2f4de86a2', 'e91248be-07bc-43ac-8b1f-48457e490e3e'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:18 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:18 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Flow 'volume_create_manager' (4b8762c2-cbf3-439b-93b9-0c43b7df4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d13fc1-e55b-412a-b686-10ebc307f9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d13fc1-e55b-412a-b686-10ebc307f9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-13604585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08b20d9-e9ae-4146-b1d4-c4904f4df5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2661a24ca7fc40c0bb19e590c36bf9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:18Z,use_quota=True,user_id='9be9d8cec3294ab09e1b81cd09f71427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e58b6f7-e1ae-495d-ab4d-263147ad18ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e58b6f7-e1ae-495d-ab4d-263147ad18ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d34262-ab03-4d85-96a2-97a944de5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d34262-ab03-4d85-96a2-97a944de5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08b20d9-e9ae-4146-b1d4-c4904f4df5b7', 'volume_name': 'volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e07f4c4-089f-4ffb-9ca7-37b3aea2a894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e07f4c4-089f-4ffb-9ca7-37b3aea2a894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a8649a-4153-4619-bffe-f116d37d91bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Volume c08b20d9-e9ae-4146-b1d4-c4904f4df5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7', 'volume_size': 1} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-13604585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08b20d9-e9ae-4146-b1d4-c4904f4df5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2661a24ca7fc40c0bb19e590c36bf9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:18Z,use_quota=True,user_id='9be9d8cec3294ab09e1b81cd09f71427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Creating volume c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:18 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:18 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 1073741824 Sep 29 12:03:18 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Flow 'volume_create_manager' (77ac8aa0-f5a6-49b3-a892-25848f6f58c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba22d00-f5da-49be-ad8e-f945ca506719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba22d00-f5da-49be-ad8e-f945ca506719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1735569303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92f2a52-8477-4753-9f91-4c8871de59f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0783c8c1b8264854a53aa8a6614a7ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:18Z,use_quota=True,user_id='84705a6c14c844dbb680dc02c213192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb07b77d-789c-430a-a5b7-b6dc271d3870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb07b77d-789c-430a-a5b7-b6dc271d3870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874e3248-356c-4722-9c37-2780ba7d64fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874e3248-356c-4722-9c37-2780ba7d64fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92f2a52-8477-4753-9f91-4c8871de59f4', 'volume_name': 'volume-d92f2a52-8477-4753-9f91-4c8871de59f4', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1faf8-ad4a-467c-801e-1fd5c9d96837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1faf8-ad4a-467c-801e-1fd5c9d96837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975038f1-592f-4a06-97e1-f08b0df19d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:18 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Volume d92f2a52-8477-4753-9f91-4c8871de59f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92f2a52-8477-4753-9f91-4c8871de59f4', 'volume_size': 1} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:18 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.318s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-7e383bf1-7ddd-4e39-96dc-fd238014ebe0-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Deleted volume successfully. Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Lock "cinder-7e383bf1-7ddd-4e39-96dc-fd238014ebe0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-68a74294-3679-45c0-8bfd-42e74971d5a8 tempest-VolumesGetTest-1261209847 None] Lock "cinder-d34cd2a8-f0ef-483b-98a9-c33bb98ce4b3-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-7e383bf1-7ddd-4e39-96dc-fd238014ebe0" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-7e383bf1-7ddd-4e39-96dc-fd238014ebe0" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b00b52c-f598-448c-8273-323e6c5d4e07]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:18 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 Sep 29 12:03:18 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:19 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 1073741824" returned: 0 in 0.644s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:19 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 Sep 29 12:03:19 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Flow 'volume_create_manager' (b79ccab6-307c-4c6e-b3e9-64b38656945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:19 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3959a6e2-ace1-4baa-8f02-e9e740ab9222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0" returned: 0 in 0.480s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3959a6e2-ace1-4baa-8f02-e9e740ab9222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf1e044-198a-4c0a-bac1-dd63ac63734a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b02cba8e38a45f1966f1c954ffb7c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:19Z,use_quota=True,user_id='306ffda00c0d47e3add59b0716525176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:19 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0 Sep 29 12:03:19 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad23e31b-14ce-4136-a4dd-77321c57cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad23e31b-14ce-4136-a4dd-77321c57cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e345d58f-28e5-4ba6-9adc-2ca7c94bcb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e345d58f-28e5-4ba6-9adc-2ca7c94bcb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf1e044-198a-4c0a-bac1-dd63ac63734a', 'volume_name': 'volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ec1a0a-f364-4166-a57e-a6928d9ec5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ec1a0a-f364-4166-a57e-a6928d9ec5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01424d8d-84d7-4d3e-a533-926c874d92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Volume aaf1e044-198a-4c0a-bac1-dd63ac63734a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a', 'volume_size': 1} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:19 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7" returned: 0 in 0.256s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1735569303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92f2a52-8477-4753-9f91-4c8871de59f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0783c8c1b8264854a53aa8a6614a7ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:18Z,use_quota=True,user_id='84705a6c14c844dbb680dc02c213192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Creating volume d92f2a52-8477-4753-9f91-4c8871de59f4 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:19 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a8649a-4153-4619-bffe-f116d37d91bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:19 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 1073741824 Sep 29 12:03:19 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b52098-729a-4b46-b282-364ce99729c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Volume volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 (c08b20d9-e9ae-4146-b1d4-c4904f4df5b7): created successfully Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b52098-729a-4b46-b282-364ce99729c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Flow 'volume_create_manager' (4b8762c2-cbf3-439b-93b9-0c43b7df4769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4798209d-df5a-4991-9d85-dc12c16b6763 tempest-VolumesTransfersV355Test-2112559784 None] Created volume successfully. Sep 29 12:03:19 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7e383bf1-7ddd-4e39-96dc-fd238014ebe0" returned: 0 in 0.294s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-7e383bf1-7ddd-4e39-96dc-fd238014ebe0" released by "delete_volume" :: held 0.828s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Created reservations ['06c2b435-b84f-4c77-9dc0-aa1c7ffc6c74', 'e7c7bd46-73cd-4204-bc61-9d08c776f6ba', '8d8e6b6b-221d-45f6-9370-135db985eb03', '6e157c5c-e9e1-4f9e-a5b0-4a080fe6175f'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:19 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:19 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:19 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Deleted volume successfully. Sep 29 12:03:19 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 1073741824" returned: 0 in 0.511s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-804657ff-b452-4c2a-befc-34ec2ed8734b tempest-VolumesGetTest-1261209847 None] Lock "cinder-7e383bf1-7ddd-4e39-96dc-fd238014ebe0-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:19 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 Sep 29 12:03:19 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:20 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4" returned: 0 in 0.329s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf1e044-198a-4c0a-bac1-dd63ac63734a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b02cba8e38a45f1966f1c954ffb7c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:19Z,use_quota=True,user_id='306ffda00c0d47e3add59b0716525176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Creating volume aaf1e044-198a-4c0a-bac1-dd63ac63734a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:20 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975038f1-592f-4a06-97e1-f08b0df19d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92f2a52-8477-4753-9f91-4c8871de59f4', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:20 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a 1073741824 Sep 29 12:03:20 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dddc71d-5054-4ab1-8b68-d31cfdb2dcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Volume volume-d92f2a52-8477-4753-9f91-4c8871de59f4 (d92f2a52-8477-4753-9f91-4c8871de59f4): created successfully Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dddc71d-5054-4ab1-8b68-d31cfdb2dcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Flow 'volume_create_manager' (77ac8aa0-f5a6-49b3-a892-25848f6f58c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-293604fd-b0e5-406c-af70-5d84a9d8a948 tempest-VolumesTransfersV357Test-2092923795 None] Created volume successfully. Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (f6eaa868-122c-4093-b30a-476cf1494d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e5ad5b-c415-4bac-b75d-1c991ad74f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e5ad5b-c415-4bac-b75d-1c991ad74f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-927919731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0e9264-f32d-4825-bece-c7b2c1f27a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:20Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e21eda-db1e-4a83-81fa-2c62e22add5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e21eda-db1e-4a83-81fa-2c62e22add5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8671b6e9-a0c8-48fc-a7c8-1e0f4ea1bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8671b6e9-a0c8-48fc-a7c8-1e0f4ea1bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0e9264-f32d-4825-bece-c7b2c1f27a77', 'volume_name': 'volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d8231a-7e62-4843-9d12-9cb774351734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d8231a-7e62-4843-9d12-9cb774351734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048f0909-bc4c-483b-98c7-fccec9e712e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Volume 8d0e9264-f32d-4825-bece-c7b2c1f27a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77', 'volume_size': 1} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Acquiring lock "cinder-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Acquiring lock "cinder-quobyte-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-quobyte-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee516b7-2aeb-436e-b9cb-8c1d17edb75c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:20 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 Sep 29 12:03:20 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:20 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a 1073741824" returned: 0 in 0.489s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:20 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a Sep 29 12:03:20 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:21 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7" returned: 0 in 0.381s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:21 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7 Sep 29 12:03:21 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:21 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a" returned: 0 in 0.249s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-927919731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0e9264-f32d-4825-bece-c7b2c1f27a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:20Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Creating volume 8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:21 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01424d8d-84d7-4d3e-a533-926c874d92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3e0443-fc8e-477c-a5d2-51cf9684561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:21 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 1073741824 Sep 29 12:03:21 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:21 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Volume volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a (aaf1e044-198a-4c0a-bac1-dd63ac63734a): created successfully Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3e0443-fc8e-477c-a5d2-51cf9684561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Flow 'volume_create_manager' (b79ccab6-307c-4c6e-b3e9-64b38656945b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-12afc324-78e2-478a-9a7a-601a0317f246 tempest-VolumesListAdminTestJSON-1695656678 None] Created volume successfully. Sep 29 12:03:21 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7" returned: 0 in 0.314s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-quobyte-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7" released by "delete_volume" :: held 0.760s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Acquiring lock "cinder-aaf1e044-198a-4c0a-bac1-dd63ac63734a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "cinder-aaf1e044-198a-4c0a-bac1-dd63ac63734a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Created reservations ['038cb0b1-c9c0-4588-8208-9afbbf71f5d7', '19af67b5-2636-42da-8506-97a75e357b79', '450bc225-2445-4c2a-a9c1-20385b49aaa3', '69e414aa-0150-411b-a5d0-c3e581e10d8d'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Acquiring lock "cinder-quobyte-aaf1e044-198a-4c0a-bac1-dd63ac63734a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "cinder-quobyte-aaf1e044-198a-4c0a-bac1-dd63ac63734a" acquired by "delete_volume" :: waited 0.048s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8e2b0-0d8b-4cb2-a6dd-41f76b3d51e6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "cinder-ce875291-6eb7-4e31-b14c-09c4c50b7775-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:21 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:21 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-ce875291-6eb7-4e31-b14c-09c4c50b7775-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "cinder-quobyte-ce875291-6eb7-4e31-b14c-09c4c50b7775" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Acquiring lock "cinder-d92f2a52-8477-4753-9f91-4c8871de59f4-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-d92f2a52-8477-4753-9f91-4c8871de59f4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-quobyte-ce875291-6eb7-4e31-b14c-09c4c50b7775" acquired by "delete_volume" :: waited 0.082s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:21 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 1073741824" returned: 0 in 0.812s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa508f-4b51-4c91-8b8b-09bc32645aea]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:21 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a Sep 29 12:03:21 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Acquiring lock "cinder-quobyte-d92f2a52-8477-4753-9f91-4c8871de59f4" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:21 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.382s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:21 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-quobyte-d92f2a52-8477-4753-9f91-4c8871de59f4" acquired by "delete_volume" :: waited 0.053s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:22 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 Sep 29 12:03:22 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Deleted volume successfully. Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[639a4f85-28de-4468-8019-014e1c065337]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:22 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 Sep 29 12:03:22 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-56e2a11d-9c11-4942-9201-20ae4db6839b tempest-VolumesTransfersV355Test-1679526089 None] Lock "cinder-c08b20d9-e9ae-4146-b1d4-c4904f4df5b7-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:22 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 Sep 29 12:03:22 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:22 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a" returned: 0 in 0.752s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:22 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77" returned: 0 in 0.413s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:22 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a Sep 29 12:03:22 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:22 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775" returned: 0 in 0.542s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048f0909-bc4c-483b-98c7-fccec9e712e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4e4946-ccda-464d-b107-e640fd6c8607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:22 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775 Sep 29 12:03:22 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Volume volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 (8d0e9264-f32d-4825-bece-c7b2c1f27a77): created successfully Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4e4946-ccda-464d-b107-e640fd6c8607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (f6eaa868-122c-4093-b30a-476cf1494d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9f91ea8e-bdfd-43f1-bafe-3058ab74c794 tempest-VolumesGetTest-1261209847 None] Created volume successfully. Sep 29 12:03:22 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4" returned: 0 in 0.550s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:22 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4 Sep 29 12:03:22 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:22 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-aaf1e044-198a-4c0a-bac1-dd63ac63734a" returned: 0 in 0.362s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:22 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "cinder-quobyte-aaf1e044-198a-4c0a-bac1-dd63ac63734a" released by "delete_volume" :: held 1.216s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ce875291-6eb7-4e31-b14c-09c4c50b7775" returned: 0 in 0.344s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-quobyte-ce875291-6eb7-4e31-b14c-09c4c50b7775" released by "delete_volume" :: held 0.962s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Created reservations ['fff69b39-d84b-4635-967f-2c1164b7f876', '0cf71065-4df1-4976-a098-627426018904', '7cc90052-96ff-4a85-978f-90bd7dc7241c', '6c69e0ac-a9dd-4b41-8e7e-ad800ab0fe18'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Created reservations ['cbcb713c-7b90-4206-9cbd-d000a01cb038', 'eaa4eb1a-d972-463f-8076-4e4846db83af', '3cf5d34f-c390-49cc-97cb-20fe6fc9967d', '29df869c-ca6d-4a36-960a-9b67b3b48a08'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:22 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d92f2a52-8477-4753-9f91-4c8871de59f4" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-quobyte-d92f2a52-8477-4753-9f91-4c8871de59f4" released by "delete_volume" :: held 0.976s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:23 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:23 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:23 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:23 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Created reservations ['9fbba07e-7520-4929-952e-53800b189fb8', 'aff4c6ca-d34f-4b03-84ed-021356747a08', 'eb8dab25-b303-4e49-ba59-bf0490177625', 'db1ebea8-b2f2-42d5-beb0-cb7d147c12d0'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:23 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:23 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:23 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:23 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Deleted volume successfully. Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0dae3c10-622a-461a-b5d4-b537c727fd09 tempest-VolumesListAdminTestJSON-1695656678 None] Lock "cinder-aaf1e044-198a-4c0a-bac1-dd63ac63734a-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:23 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.332s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:23 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Deleted volume successfully. Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90169e31-58cf-4e2d-92d8-561ec35a086e tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-ce875291-6eb7-4e31-b14c-09c4c50b7775-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:23 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.310s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:23 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Deleted volume successfully. Sep 29 12:03:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-af64214d-8c4c-4144-85cc-57f63e15a780 tempest-VolumesTransfersV357Test-786278553 None] Lock "cinder-d92f2a52-8477-4753-9f91-4c8871de59f4-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "cinder-65e46adb-6893-4718-9ce4-808551926b44-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-65e46adb-6893-4718-9ce4-808551926b44-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "cinder-quobyte-65e46adb-6893-4718-9ce4-808551926b44" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-quobyte-65e46adb-6893-4718-9ce4-808551926b44" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b822b3d6-c8ec-4491-9f53-9dc075bfc873]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (3d5de377-3224-4d85-af21-67ded544f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:24 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 Sep 29 12:03:24 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977976ed-9b9d-4241-8e50-29b4558d7c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977976ed-9b9d-4241-8e50-29b4558d7c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2126604817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ce3058-3af3-41a1-b0a2-4bacc8a70e25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8d0e9264-f32d-4825-bece-c7b2c1f27a77,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:24Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7481679b-86c7-410a-bfe6-fc50caa52f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7481679b-86c7-410a-bfe6-fc50caa52f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e2fdad-7acb-48a9-b203-12557b61fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e2fdad-7acb-48a9-b203-12557b61fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '19ce3058-3af3-41a1-b0a2-4bacc8a70e25', 'volume_name': 'volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25', 'volume_size': 1, 'source_volid': '8d0e9264-f32d-4825-bece-c7b2c1f27a77', 'source_volstatus': 'available'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502b1e55-5f3c-45a3-8b02-5da3a6d7c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502b1e55-5f3c-45a3-8b02-5da3a6d7c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8405605a-bc9e-4147-9d7d-5b676d51f5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:24 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Volume 19ce3058-3af3-41a1-b0a2-4bacc8a70e25: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25', 'volume_size': 1, 'source_volid': '8d0e9264-f32d-4825-bece-c7b2c1f27a77', 'source_volstatus': 'available'} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:24 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Cloning volume 8d0e9264-f32d-4825-bece-c7b2c1f27a77 to volume 19ce3058-3af3-41a1-b0a2-4bacc8a70e25 Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Creating offline snapshot 0ddc57d2-ba68-41ef-8215-07af16c7613c of volume 8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e960c29-fc86-4466-a381-527eb0274ba3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:24 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44" returned: 0 in 0.477s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:24 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 Sep 29 12:03:24 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:24 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44 Sep 29 12:03:24 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:24 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-65e46adb-6893-4718-9ce4-808551926b44" returned: 0 in 0.288s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-quobyte-65e46adb-6893-4718-9ce4-808551926b44" released by "delete_volume" :: held 0.819s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:24 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77" returned: 0 in 0.478s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:25 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c 1G Sep 29 12:03:25 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Created reservations ['13570c3c-e2ed-4915-9ca3-44c749e0d750', '81e89304-92b0-45c0-a67a-0cb657d5512e', '15ccb900-6106-4e11-87ea-e364017afc93', 'e40e62b0-aada-4943-b030-b04b5e0d71fd'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:25 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:25 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "cinder-4c5e6147-c457-4dab-9522-1048df0d2e2f-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-4c5e6147-c457-4dab-9522-1048df0d2e2f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "cinder-quobyte-4c5e6147-c457-4dab-9522-1048df0d2e2f" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-quobyte-4c5e6147-c457-4dab-9522-1048df0d2e2f" acquired by "delete_volume" :: waited 0.038s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:25 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.355s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Deleted volume successfully. Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcae3dfd-e7bb-4d86-9c52-8c36806d30a6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4c3d3299-9f6d-4986-8fd6-1dfe275b72ac tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-65e46adb-6893-4718-9ce4-808551926b44-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:25 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f Sep 29 12:03:25 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:25 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c 1G" returned: 0 in 0.705s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:25 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c Sep 29 12:03:25 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:26 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f" returned: 0 in 0.485s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:26 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f Sep 29 12:03:26 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:26 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c" returned: 0 in 0.368s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:26 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c is being set with open permissions: ugo+rw Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:26 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c Sep 29 12:03:26 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:26 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4c5e6147-c457-4dab-9522-1048df0d2e2f" returned: 0 in 0.423s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:26 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c" returned: 0 in 0.383s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-quobyte-4c5e6147-c457-4dab-9522-1048df0d2e2f" released by "delete_volume" :: held 0.981s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:26 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.info Sep 29 12:03:26 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Created reservations ['6a3cf52a-a580-41bb-9a68-dab5daf13554', '6c15d55e-f47c-439e-af82-0d721767978b', 'adf0438f-c44a-44d9-8152-87116fe4b703', '008e9e8c-ecf5-48eb-82f7-390713632860'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:26 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:26 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:26 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.info" returned: 0 in 0.399s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:26 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.info is being set with open permissions: ugo+rw Sep 29 12:03:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:26 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.info Sep 29 12:03:26 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:27 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.321s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:27 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Deleted volume successfully. Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-74efc363-f0da-4745-8b44-1af59dae3bb9 tempest-VolumesListAdminTestJSON-761396136 None] Lock "cinder-4c5e6147-c457-4dab-9522-1048df0d2e2f-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:27 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.info" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] snapshot: 0ddc57d2-ba68-41ef-8215-07af16c7613c, volume: 19ce3058-3af3-41a1-b0a2-4bacc8a70e25, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[602b1869-cc2d-4f70-9228-c022ba73078e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:27 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c Sep 29 12:03:27 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:27 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c" returned: 0 in 0.465s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e14c9d-7990-4b6d-9c4e-ec8fb2932136]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:27 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 Sep 29 12:03:27 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:28 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77" returned: 0 in 0.445s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:03:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:03:28 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:03:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:28 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 Sep 29 12:03:28 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:36 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=113,cinder:SELECT=83,cinder:DELETE=8,cinder:INSERT=26 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:03:36 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" returned: 0 in 8.706s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:03:37 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Converted 1024.00 MB image at 117.60 MB/s Sep 29 12:03:37 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 is being set with open permissions: ugo+rw Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:37 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 Sep 29 12:03:37 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=70,cinder:INSERT=27,cinder:UPDATE=114,cinder:DELETE=13 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:03:37 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" released by "_copy_volume_from_snapshot" :: held 10.068s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-0ddc57d2-ba68-41ef-8215-07af16c7613c" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-0ddc57d2-ba68-41ef-8215-07af16c7613c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Deleting offline snapshot 0ddc57d2-ba68-41ef-8215-07af16c7613c of volume 8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] snapshot_file for this snap is: volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e442c8-b8c6-46ce-9c5a-81eada43b466]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:37 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c Sep 29 12:03:37 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:37 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c" returned: 0 in 0.457s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2122915-6efd-4668-898e-c33d6c61eaaa]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:38 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 Sep 29 12:03:38 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:38 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77" returned: 0 in 0.855s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:38 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c Sep 29 12:03:38 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:39 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c" returned: 0 in 0.538s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:39 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c Sep 29 12:03:39 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Flow 'volume_create_manager' (278d7f49-a245-425a-8110-584e943282da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d1cc01-bce6-4272-92fa-f030534fc70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d1cc01-bce6-4272-92fa-f030534fc70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1478026357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d57add4-57e1-42aa-a7c6-41a3ddcbc09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cfa312523fc4bef8c250359e6954c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:40Z,use_quota=True,user_id='19a574cb23134ea79f93664732c958e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa7fe9d-7a0b-438e-be12-6fa82f694d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:39 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa7fe9d-7a0b-438e-be12-6fa82f694d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0928b40-5ecc-4e01-80c4-fed26784b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0928b40-5ecc-4e01-80c4-fed26784b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d57add4-57e1-42aa-a7c6-41a3ddcbc09d', 'volume_name': 'volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc825e-fa26-43fa-ba3f-bbdd676e1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc825e-fa26-43fa-ba3f-bbdd676e1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd9dfcb-2286-4636-b113-6c9e3a7f85fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:39 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Volume 0d57add4-57e1-42aa-a7c6-41a3ddcbc09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d', 'volume_size': 1} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77.0ddc57d2-ba68-41ef-8215-07af16c7613c" returned: 0 in 0.379s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-0ddc57d2-ba68-41ef-8215-07af16c7613c" released by "_delete_snapshot" :: held 2.396s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.394s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1478026357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d57add4-57e1-42aa-a7c6-41a3ddcbc09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cfa312523fc4bef8c250359e6954c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:40Z,use_quota=True,user_id='19a574cb23134ea79f93664732c958e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Creating volume 0d57add4-57e1-42aa-a7c6-41a3ddcbc09d {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:39 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8405605a-bc9e-4147-9d7d-5b676d51f5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25', 'volume_size': 1, 'source_volid': '8d0e9264-f32d-4825-bece-c7b2c1f27a77', 'source_volstatus': 'available'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:39 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d 1073741824 Sep 29 12:03:39 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6baf36b-8d52-46a8-970d-67f9ab82da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:39 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Volume volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 (19ce3058-3af3-41a1-b0a2-4bacc8a70e25): created successfully Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6baf36b-8d52-46a8-970d-67f9ab82da35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (3d5de377-3224-4d85-af21-67ded544f49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-03617651-b647-4c6a-b4a8-ea872e1e2763 tempest-VolumesGetTest-1261209847 None] Created volume successfully. Sep 29 12:03:40 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d 1073741824" returned: 0 in 0.552s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:40 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d Sep 29 12:03:40 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:40 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d" returned: 0 in 0.397s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd9dfcb-2286-4636-b113-6c9e3a7f85fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26f9bd-bdc4-4586-9d25-392d56b7caf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:40 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Volume volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d (0d57add4-57e1-42aa-a7c6-41a3ddcbc09d): created successfully Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26f9bd-bdc4-4586-9d25-392d56b7caf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Flow 'volume_create_manager' (278d7f49-a245-425a-8110-584e943282da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a42f503a-b231-4e0b-9248-0ba6ae7b157e tempest-AbsoluteLimitsTests-1212236477 None] Created volume successfully. Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (4a4cd092-2555-470f-ac22-def9682dc026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2896dfe2-8403-4b7c-95e5-26df39b07940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2896dfe2-8403-4b7c-95e5-26df39b07940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-358163653',display_name='tempest-VolumesGetTest-Volume-1951077117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ceed50-2e87-49a4-a0da-0c34cc47e96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:42Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43d12dd-18d4-4026-983a-5fea44292bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43d12dd-18d4-4026-983a-5fea44292bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7871a08c-db84-4b39-85a0-dcbf183e35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7871a08c-db84-4b39-85a0-dcbf183e35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ceed50-2e87-49a4-a0da-0c34cc47e96a', 'volume_name': 'volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20387926-afa8-4459-aa59-ea62d660e9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20387926-afa8-4459-aa59-ea62d660e9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59415741-1393-494a-8389-9bc96c437c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:41 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Volume e1ceed50-2e87-49a4-a0da-0c34cc47e96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a', 'volume_size': 1} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-358163653',display_name='tempest-VolumesGetTest-Volume-1951077117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ceed50-2e87-49a4-a0da-0c34cc47e96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:42Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Creating volume e1ceed50-2e87-49a4-a0da-0c34cc47e96a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:41 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:41 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a 1073741824 Sep 29 12:03:41 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Acquiring lock "cinder-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Lock "cinder-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Acquiring lock "cinder-quobyte-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Lock "cinder-quobyte-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1d0b13-8f74-4c62-b71e-dcfe37be8d52]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:42 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d Sep 29 12:03:42 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:42 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a 1073741824" returned: 0 in 0.766s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:42 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d" returned: 0 in 0.514s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:42 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a Sep 29 12:03:42 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:42 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d Sep 29 12:03:42 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:43 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a" returned: 0 in 0.326s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59415741-1393-494a-8389-9bc96c437c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70195e72-2210-4cce-9fd1-7af561b97600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:43 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Volume volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a (e1ceed50-2e87-49a4-a0da-0c34cc47e96a): created successfully Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70195e72-2210-4cce-9fd1-7af561b97600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (4a4cd092-2555-470f-ac22-def9682dc026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:43 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d" returned: 0 in 0.379s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-900cdde8-a3c7-47aa-9645-ee9ef83234d7 tempest-VolumesGetTest-1261209847 None] Created volume successfully. Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Lock "cinder-quobyte-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d" released by "delete_volume" :: held 0.977s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Created reservations ['390a95b9-aed8-42e1-94b8-bd501d7d230b', '00ca5907-9df0-492c-916c-aa75a31fa572', '779c0410-de58-46ae-9612-0eb5d6c973c9', 'c6f2226b-e655-4473-9e63-02ecd53ea3a9'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:43 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:43 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:43 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.328s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Deleted volume successfully. Sep 29 12:03:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0b20de47-525e-46f1-94ba-00c6dbb8cf6f tempest-AbsoluteLimitsTests-1212236477 None] Lock "cinder-0d57add4-57e1-42aa-a7c6-41a3ddcbc09d-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-e1ceed50-2e87-49a4-a0da-0c34cc47e96a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Lock "cinder-e1ceed50-2e87-49a4-a0da-0c34cc47e96a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-e1ceed50-2e87-49a4-a0da-0c34cc47e96a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-e1ceed50-2e87-49a4-a0da-0c34cc47e96a" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2b00a-e3f0-4e0e-82e1-3fc64b54a3fc]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:44 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a Sep 29 12:03:44 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:44 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a" returned: 0 in 0.493s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:44 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a Sep 29 12:03:44 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:44 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1ceed50-2e87-49a4-a0da-0c34cc47e96a" returned: 0 in 0.334s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-e1ceed50-2e87-49a4-a0da-0c34cc47e96a" released by "delete_volume" :: held 0.894s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Created reservations ['0903c14a-25b3-4163-be35-fe14d442be25', '2a948853-daf5-4449-9e25-62485226a362', '24ccbc6f-09e3-4d93-905f-a702ab4f286d', 'dae60c1d-b8c6-4309-9886-da3eaf98d5a6'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:45 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:45 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-19ce3058-3af3-41a1-b0a2-4bacc8a70e25-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Lock "cinder-19ce3058-3af3-41a1-b0a2-4bacc8a70e25-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:45 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.430s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c978834-d566-4a99-91fc-404c74effd37]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Deleted volume successfully. Sep 29 12:03:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ab6e764-eb84-4516-aca6-8f4d9a9a9e6e tempest-VolumesGetTest-1261209847 None] Lock "cinder-e1ceed50-2e87-49a4-a0da-0c34cc47e96a-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:45 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 Sep 29 12:03:45 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:46 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" returned: 0 in 0.438s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:46 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25 Sep 29 12:03:46 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:46 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-19ce3058-3af3-41a1-b0a2-4bacc8a70e25" released by "delete_volume" :: held 0.855s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Created reservations ['c039c91e-dd2e-4409-8c0c-a76c9d2082e0', '89e4dbe8-e386-4d33-9b87-ef97dbadff98', '249fcf2b-337e-4908-92eb-5a62ce346ffa', 'cf8cbf54-4314-40a5-9ff4-322559d73ee2'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:46 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:46 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-8d0e9264-f32d-4825-bece-c7b2c1f27a77-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Lock "cinder-8d0e9264-f32d-4825-bece-c7b2c1f27a77-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:46 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.375s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-8d0e9264-f32d-4825-bece-c7b2c1f27a77" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:47 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Deleted volume successfully. Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fc4b676f-5f29-4459-a251-ac5d52fe5f4b tempest-VolumesGetTest-1261209847 None] Lock "cinder-19ce3058-3af3-41a1-b0a2-4bacc8a70e25-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-8d0e9264-f32d-4825-bece-c7b2c1f27a77" acquired by "delete_volume" :: waited 0.060s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8cce26-d01a-46e2-b14e-ed265ad67602]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:47 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 Sep 29 12:03:47 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:47 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77" returned: 0 in 0.492s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:47 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77 Sep 29 12:03:47 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:48 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8d0e9264-f32d-4825-bece-c7b2c1f27a77" returned: 0 in 0.452s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-8d0e9264-f32d-4825-bece-c7b2c1f27a77" released by "delete_volume" :: held 1.058s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Created reservations ['87d9e642-1cd8-48ab-a218-15f570686d5c', '3429c856-e2b1-42e5-8a18-de61b3e4e1f0', 'cd04e925-07b2-4288-9ebd-916f3811cd0b', 'd4188062-c9d9-4cd4-be1e-7725d7551218'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:48 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:03:48 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:48 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.489s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:03:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Deleted volume successfully. Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3c175a29-7f36-4223-848a-169318b27ad4 tempest-VolumesGetTest-1261209847 None] Lock "cinder-8d0e9264-f32d-4825-bece-c7b2c1f27a77-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Flow 'volume_create_manager' (55c6c93c-fcd1-41d4-9ea5-2bf532e30fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67510d8-21d7-4055-bca3-8ff1da72f18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67510d8-21d7-4055-bca3-8ff1da72f18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-757879805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fd3a75-46fb-4462-97fb-0d5da723c3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f7f9a2b6cb4fc08421431dd33bd819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:49Z,use_quota=True,user_id='00430c291da24df4b4fab072af657cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4253a8b7-5e61-42c2-8ae7-2ff110ae971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4253a8b7-5e61-42c2-8ae7-2ff110ae971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1518ad-c51a-48e2-9a32-9b17088179dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1518ad-c51a-48e2-9a32-9b17088179dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fd3a75-46fb-4462-97fb-0d5da723c3cc', 'volume_name': 'volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610902c-f211-4545-aa94-bb7af254e9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610902c-f211-4545-aa94-bb7af254e9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a66b321-642e-4375-b50d-da884cfff681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Volume a9fd3a75-46fb-4462-97fb-0d5da723c3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc', 'volume_size': 1} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-757879805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fd3a75-46fb-4462-97fb-0d5da723c3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f7f9a2b6cb4fc08421431dd33bd819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:49Z,use_quota=True,user_id='00430c291da24df4b4fab072af657cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Creating volume a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:49 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:49 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc 1073741824 Sep 29 12:03:49 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:49 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc 1073741824" returned: 0 in 0.738s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:49 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:03:49 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:50 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.361s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a66b321-642e-4375-b50d-da884cfff681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa1bbf-4d9d-462d-b45a-69781f9dc6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Volume volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc (a9fd3a75-46fb-4462-97fb-0d5da723c3cc): created successfully Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa1bbf-4d9d-462d-b45a-69781f9dc6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Flow 'volume_create_manager' (55c6c93c-fcd1-41d4-9ea5-2bf532e30fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6bd3ccbd-4aef-4833-b926-1891129391b9 tempest-VolumesActionsTest-689240211 None] Created volume successfully. Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (bc78a651-efb6-4a26-bc25-85f97ee511b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df33727-9f24-4c49-8677-fda9a25ae2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df33727-9f24-4c49-8677-fda9a25ae2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1714828038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7edab2-c36f-4d34-ba61-8ce5f97834f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:51Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b407cf09-9eeb-4c74-8603-565d66fd2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b407cf09-9eeb-4c74-8603-565d66fd2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f7fae2-a4b2-45dc-b4d4-033c84a623ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:50 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f7fae2-a4b2-45dc-b4d4-033c84a623ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c7edab2-c36f-4d34-ba61-8ce5f97834f7', 'volume_name': 'volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f37de20-fddb-4793-b554-2f0dbcf9ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f37de20-fddb-4793-b554-2f0dbcf9ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c73dab3-40d3-4b05-9d40-113498c1980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Volume 1c7edab2-c36f-4d34-ba61-8ce5f97834f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Trying to clone 1c7edab2-c36f-4d34-ba61-8ce5f97834f7 from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:03:51 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a263f4-5c73-4a89-a415-84d33e69dcae]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:52 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD Sep 29 12:03:52 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:52 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:52 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a is fetched for user 7aeb32b60bcd4d7daeeb554ce819b395. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:03:52 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[10caed89-62e5-4c48-80f3-91fa9a757e85]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:52 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD Sep 29 12:03:52 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:53 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1714828038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7edab2-c36f-4d34-ba61-8ce5f97834f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:51Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Creating volume 1c7edab2-c36f-4d34-ba61-8ce5f97834f7 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:53 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:53 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 1073741824 Sep 29 12:03:53 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:53 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 1073741824" returned: 0 in 0.748s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:54 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 Sep 29 12:03:54 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:54 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7" returned: 0 in 0.299s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:54 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Attempting download of 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 1c7edab2-c36f-4d34-ba61-8ce5f97834f7. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:03:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ec19f7-5936-484a-bc1f-bebd2225a91f]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_f_jkgrpl {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:54 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_f_jkgrpl Sep 29 12:03:54 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:03:55 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Flow 'volume_create_manager' (7b8b4ee3-d0eb-4afc-a85b-7b0a5ca2d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ca2047-db82-49bd-a091-6bafe6508a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_f_jkgrpl" returned: 0 in 0.610s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_f_jkgrpl {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ca2047-db82-49bd-a091-6bafe6508a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-243620683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b551ba-1f81-4eac-9b01-b402182959a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61889248c1604350ac78817fe641e92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:55Z,use_quota=True,user_id='1aa854503adb407f804c7916b813450a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb569074-aeb2-46fe-a646-9e281bcf4f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb569074-aeb2-46fe-a646-9e281bcf4f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541fbb15-250b-4222-a847-a351aeeb4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541fbb15-250b-4222-a847-a351aeeb4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b551ba-1f81-4eac-9b01-b402182959a2', 'volume_name': 'volume-94b551ba-1f81-4eac-9b01-b402182959a2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4ca271-49c2-439f-bc52-f376a6d5daa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4ca271-49c2-439f-bc52-f376a6d5daa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c9ff03-e8cc-4728-8ade-84fdd46f7134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:55 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Volume 94b551ba-1f81-4eac-9b01-b402182959a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b551ba-1f81-4eac-9b01-b402182959a2', 'volume_size': 1} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-243620683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b551ba-1f81-4eac-9b01-b402182959a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61889248c1604350ac78817fe641e92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:03:55Z,use_quota=True,user_id='1aa854503adb407f804c7916b813450a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Creating volume 94b551ba-1f81-4eac-9b01-b402182959a2 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:03:55 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:55 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 1073741824 Sep 29 12:03:55 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:55 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_f_jkgrpl Sep 29 12:03:55 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:55 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_f_jkgrpl" returned: 1 in 0.535s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_f_jkgrpl' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5c6f0-4478-43e7-bd1e-a999aaa21028]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:55 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD Sep 29 12:03:55 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:55 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 1073741824" returned: 0 in 0.671s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:55 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 Sep 29 12:03:55 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:56 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD" returned: 0 in 0.564s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] 2eff10fc-36b0-4954-8584-fe8c9e38eb2a was qcow2, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:56 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 Sep 29 12:03:56 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:56 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2" returned: 0 in 0.407s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c9ff03-e8cc-4728-8ade-84fdd46f7134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b551ba-1f81-4eac-9b01-b402182959a2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7671569-34ad-4717-905f-3bb22e007a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:56 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Volume volume-94b551ba-1f81-4eac-9b01-b402182959a2 (94b551ba-1f81-4eac-9b01-b402182959a2): created successfully Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7671569-34ad-4717-905f-3bb22e007a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Flow 'volume_create_manager' (7b8b4ee3-d0eb-4afc-a85b-7b0a5ca2d623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:03:56 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-01bc4ab9-4091-4b0c-9771-0bbaa3a9e5b1 tempest-VolumesMetadataTest-669425703 None] Created volume successfully. Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Acquiring lock "cinder-94b551ba-1f81-4eac-9b01-b402182959a2-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Lock "cinder-94b551ba-1f81-4eac-9b01-b402182959a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Acquiring lock "cinder-quobyte-94b551ba-1f81-4eac-9b01-b402182959a2" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Lock "cinder-quobyte-94b551ba-1f81-4eac-9b01-b402182959a2" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ec833-adba-49cd-8ef1-8a0933b0b03c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:58 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 Sep 29 12:03:58 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:58 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7" returned: 0 in 2.753s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:58 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_qfoulq42devstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:03:58 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Converted 112.00 MB image at 40.67 MB/s Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:59 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 1G Sep 29 12:03:59 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:59 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2" returned: 0 in 0.511s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:03:59 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2 Sep 29 12:03:59 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:03:59 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 1G" returned: 0 in 0.627s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Downloaded image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 1c7edab2-c36f-4d34-ba61-8ce5f97834f7 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a for user 7aeb32b60bcd4d7daeeb554ce819b395 is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Marking volume 1c7edab2-c36f-4d34-ba61-8ce5f97834f7 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Copying metadata from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a to 1c7edab2-c36f-4d34-ba61-8ce5f97834f7. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Creating volume glance metadata for volume 1c7edab2-c36f-4d34-ba61-8ce5f97834f7 backed by image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:03:59 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-94b551ba-1f81-4eac-9b01-b402182959a2" returned: 0 in 0.555s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Lock "cinder-quobyte-94b551ba-1f81-4eac-9b01-b402182959a2" released by "delete_volume" :: held 1.163s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c73dab3-40d3-4b05-9d40-113498c1980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fe0d2d-bf81-46b9-ac22-a89449dac009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:03:59 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Volume volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 (1c7edab2-c36f-4d34-ba61-8ce5f97834f7): created successfully Sep 29 12:03:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fe0d2d-bf81-46b9-ac22-a89449dac009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (bc78a651-efb6-4a26-bc25-85f97ee511b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0e6fae52-97a2-4662-856d-29ccd74050c9 tempest-VolumesGetTest-1261209847 None] Created volume successfully. Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Created reservations ['05d63cf0-1e2a-4354-bf5f-01103da41576', 'a1fb96ba-3798-4567-9a8e-66cb6d18824d', '6388a284-c179-4b1f-9964-1d4463f5fc92', '915adf41-015d-4d3d-be23-58607d7ef93b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:00 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:04:00 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:00 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.596s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:04:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Deleted volume successfully. Sep 29 12:04:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c3b76edb-37e6-428a-985f-39ad2bc11abf tempest-VolumesMetadataTest-669425703 None] Lock "cinder-94b551ba-1f81-4eac-9b01-b402182959a2-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (ac9dcf96-ee1d-4e72-b1ab-bcb46e39401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2f17c1-bfb1-49c2-844d-2f8450ac9c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2f17c1-bfb1-49c2-844d-2f8450ac9c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284854149',display_name='tempest-VolumesGetTest-Volume-1017639863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a2e9be-2772-4489-94db-945b33ba0bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:02Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da27aad4-a2e5-443a-a294-9c996d3602a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da27aad4-a2e5-443a-a294-9c996d3602a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a34e63-d562-463c-a7eb-ac53913e78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a34e63-d562-463c-a7eb-ac53913e78e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a2e9be-2772-4489-94db-945b33ba0bbb', 'volume_name': 'volume-a9a2e9be-2772-4489-94db-945b33ba0bbb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bd6cc5-1e5d-4d44-9f83-9c5d6cf3d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bd6cc5-1e5d-4d44-9f83-9c5d6cf3d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2478430c-2b5b-407b-a743-dba381bf3f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:01 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Volume a9a2e9be-2772-4489-94db-945b33ba0bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a2e9be-2772-4489-94db-945b33ba0bbb', 'volume_size': 1} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284854149',display_name='tempest-VolumesGetTest-Volume-1017639863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a2e9be-2772-4489-94db-945b33ba0bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6447046dfe4fefb54a47efb989d8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:02Z,use_quota=True,user_id='7aeb32b60bcd4d7daeeb554ce819b395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Creating volume a9a2e9be-2772-4489-94db-945b33ba0bbb {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:04:01 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:04:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:02 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb 1073741824 Sep 29 12:04:02 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:02 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb 1073741824" returned: 0 in 0.762s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:02 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb Sep 29 12:04:02 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:03 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb" returned: 0 in 0.384s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:04:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2478430c-2b5b-407b-a743-dba381bf3f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a2e9be-2772-4489-94db-945b33ba0bbb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec032cc6-58e9-4c29-a908-eeb3dfac4ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:03 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Volume volume-a9a2e9be-2772-4489-94db-945b33ba0bbb (a9a2e9be-2772-4489-94db-945b33ba0bbb): created successfully Sep 29 12:04:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec032cc6-58e9-4c29-a908-eeb3dfac4ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Flow 'volume_create_manager' (ac9dcf96-ee1d-4e72-b1ab-bcb46e39401f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-80bf4ca7-3221-4d43-abd5-5bdaf8a74fc0 tempest-VolumesGetTest-1261209847 None] Created volume successfully. Sep 29 12:04:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-a9a2e9be-2772-4489-94db-945b33ba0bbb-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Lock "cinder-a9a2e9be-2772-4489-94db-945b33ba0bbb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-a9a2e9be-2772-4489-94db-945b33ba0bbb" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-a9a2e9be-2772-4489-94db-945b33ba0bbb" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d849f11b-7376-42a5-9984-b5c0583b5d7b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:04 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb Sep 29 12:04:04 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:05 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb" returned: 0 in 0.662s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:05 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb Sep 29 12:04:05 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:05 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9a2e9be-2772-4489-94db-945b33ba0bbb" returned: 0 in 0.521s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-a9a2e9be-2772-4489-94db-945b33ba0bbb" released by "delete_volume" :: held 1.293s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Created reservations ['43364b1f-64af-49e9-9363-ee73aa077747', '17bc91c0-991d-40a0-b385-937b55c0c21b', '9f127cf2-30e8-4e67-83c1-7510849e9405', 'de0d0d5d-970d-47e4-b63d-0d6413bd64fe'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:06 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:04:06 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:06 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.366s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:04:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Deleted volume successfully. Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-550e180f-5d1e-408e-a0de-3724d351ce52 tempest-VolumesGetTest-1261209847 None] Lock "cinder-a9a2e9be-2772-4489-94db-945b33ba0bbb-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7ed8d151-4126-4f11-96fc-4429ff97a25a tempest-VolumesActionsTest-689240211 None] Acquiring lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" by "attach_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7ed8d151-4126-4f11-96fc-4429ff97a25a tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" acquired by "attach_volume" :: waited 0.040s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-1c7edab2-c36f-4d34-ba61-8ce5f97834f7-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7ed8d151-4126-4f11-96fc-4429ff97a25a tempest-VolumesActionsTest-689240211 None] Attaching volume a9fd3a75-46fb-4462-97fb-0d5da723c3cc to instance 354d0c28-8d6c-4574-91f7-83671ec9a070 at mountpoint /dev/vdb on host None. Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Lock "cinder-1c7edab2-c36f-4d34-ba61-8ce5f97834f7-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7ed8d151-4126-4f11-96fc-4429ff97a25a tempest-VolumesActionsTest-689240211 None] Attach volume completed successfully. Sep 29 12:04:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7ed8d151-4126-4f11-96fc-4429ff97a25a tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" released by "attach_volume" :: held 0.253s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Acquiring lock "cinder-quobyte-1c7edab2-c36f-4d34-ba61-8ce5f97834f7" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-1c7edab2-c36f-4d34-ba61-8ce5f97834f7" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[03167480-178c-43df-93dc-584901ba89de]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-01916d8f-8694-4b81-9131-eb18d53c5548 tempest-VolumesActionsTest-689240211 None] Acquiring lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-detach_volume" by "detach_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-01916d8f-8694-4b81-9131-eb18d53c5548 tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-01916d8f-8694-4b81-9131-eb18d53c5548 tempest-VolumesActionsTest-689240211 None] Detaching volume a9fd3a75-46fb-4462-97fb-0d5da723c3cc from instance 354d0c28-8d6c-4574-91f7-83671ec9a070. Sep 29 12:04:07 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 Sep 29 12:04:07 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-01916d8f-8694-4b81-9131-eb18d53c5548 tempest-VolumesActionsTest-689240211 None] Detach volume completed successfully. Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-01916d8f-8694-4b81-9131-eb18d53c5548 tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-detach_volume" released by "detach_volume" :: held 0.205s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:07 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7" returned: 0 in 0.663s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:07 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7 Sep 29 12:04:07 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:08 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1c7edab2-c36f-4d34-ba61-8ce5f97834f7" returned: 0 in 0.711s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Lock "cinder-quobyte-1c7edab2-c36f-4d34-ba61-8ce5f97834f7" released by "delete_volume" :: held 1.472s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Created reservations ['339f475e-e242-4c50-9a69-3a1c5cc9f270', '92f895a4-8213-48c0-a440-a6bc486ef469', 'a95922c1-11e0-452b-8ef1-ed594d2803cf', 'c55dbff9-798c-4ffd-b439-16e32aa30d10'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Flow 'volume_create_manager' (61bd279a-dea5-4cf6-aabf-b2f6d65e1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64124dc5-319e-459c-be04-5a7ca38097f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64124dc5-319e-459c-be04-5a7ca38097f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-593559485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9041fb-a088-48d7-be30-b4877f1238a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d5d57935c4316a46fb4ced6578596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:09Z,use_quota=True,user_id='3eddd49671e4404f86f0b508ee5bf1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9ceffa-e157-4e75-8021-e631d9a72be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9ceffa-e157-4e75-8021-e631d9a72be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f192f1c2-d289-4dce-b447-67e4e34cbe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f192f1c2-d289-4dce-b447-67e4e34cbe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9041fb-a088-48d7-be30-b4877f1238a6', 'volume_name': 'volume-2b9041fb-a088-48d7-be30-b4877f1238a6', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1c2504-de4d-4b9e-98a1-0404dbbfef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1c2504-de4d-4b9e-98a1-0404dbbfef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63feae16-d53b-41e6-9a0f-5f4dacf8dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Volume 2b9041fb-a088-48d7-be30-b4877f1238a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9041fb-a088-48d7-be30-b4877f1238a6', 'volume_size': 1} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-593559485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9041fb-a088-48d7-be30-b4877f1238a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d5d57935c4316a46fb4ced6578596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:09Z,use_quota=True,user_id='3eddd49671e4404f86f0b508ee5bf1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Creating volume 2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:04:08 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:04:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:09 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 1073741824 Sep 29 12:04:09 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:09 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:04:09 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:09 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.464s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:04:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Deleted volume successfully. Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-90714302-2769-4a30-9ec8-2261bded43af tempest-VolumesGetTest-1261209847 None] Lock "cinder-1c7edab2-c36f-4d34-ba61-8ce5f97834f7-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:09 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 1073741824" returned: 0 in 0.934s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:09 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 Sep 29 12:04:10 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:10 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6" returned: 0 in 0.523s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:04:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63feae16-d53b-41e6-9a0f-5f4dacf8dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9041fb-a088-48d7-be30-b4877f1238a6', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5ebd9-55cf-4478-a313-eeb5c50f8745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:10 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Volume volume-2b9041fb-a088-48d7-be30-b4877f1238a6 (2b9041fb-a088-48d7-be30-b4877f1238a6): created successfully Sep 29 12:04:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5ebd9-55cf-4478-a313-eeb5c50f8745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Flow 'volume_create_manager' (61bd279a-dea5-4cf6-aabf-b2f6d65e1598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ffc5a93e-5fc5-4113-a368-6bfb26d68e2a tempest-VolumesCloneTest-1661247175 None] Created volume successfully. Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Flow 'volume_create_manager' (a6cc5175-f89e-4a0e-9f71-7817b72a9b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6d5ebe-9abb-49f5-afab-8c3e1f8ef62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6d5ebe-9abb-49f5-afab-8c3e1f8ef62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1385323630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8e5336-7137-493f-b007-8d5edaf9ad9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d5d57935c4316a46fb4ced6578596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2b9041fb-a088-48d7-be30-b4877f1238a6,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:12Z,use_quota=True,user_id='3eddd49671e4404f86f0b508ee5bf1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db3dab3-915b-4d44-8727-f663c6d22e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db3dab3-915b-4d44-8727-f663c6d22e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80dd3e5-dc2e-42f2-bb8a-70fbdab88f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80dd3e5-dc2e-42f2-bb8a-70fbdab88f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fd8e5336-7137-493f-b007-8d5edaf9ad9e', 'volume_name': 'volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e', 'volume_size': 2, 'source_volid': '2b9041fb-a088-48d7-be30-b4877f1238a6', 'source_volstatus': 'available'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b25fa7e-cdf2-4cff-b548-2c49473812be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b25fa7e-cdf2-4cff-b548-2c49473812be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669f1eac-2078-408f-930c-3ebca6de62c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:11 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Volume fd8e5336-7137-493f-b007-8d5edaf9ad9e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e', 'volume_size': 2, 'source_volid': '2b9041fb-a088-48d7-be30-b4877f1238a6', 'source_volstatus': 'available'} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:11 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Cloning volume 2b9041fb-a088-48d7-be30-b4877f1238a6 to volume fd8e5336-7137-493f-b007-8d5edaf9ad9e Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Creating offline snapshot f154ed46-5dad-4eee-bc5b-62935bf23258 of volume 2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eda45f-f09f-4b0e-b71e-3071796b1ced]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:12 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:04:12 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:12 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 Sep 29 12:04:12 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:12 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.377s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:04:12 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6" returned: 0 in 0.489s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:12 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 1G Sep 29 12:04:12 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:13 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 1G" returned: 0 in 0.475s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9041fb-a088-48d7-be30-b4877f1238a6 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:13 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9041fb-a088-48d7-be30-b4877f1238a6 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 Sep 29 12:04:13 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:13 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9041fb-a088-48d7-be30-b4877f1238a6 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258" returned: 0 in 0.506s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:13 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 is being set with open permissions: ugo+rw Sep 29 12:04:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:13 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 Sep 29 12:04:13 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:13 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258" returned: 0 in 0.290s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:13 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.info Sep 29 12:04:13 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:14 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.info" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:14 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.info is being set with open permissions: ugo+rw Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:14 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.info Sep 29 12:04:14 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:14 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.info" returned: 0 in 0.400s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Acquiring lock "cinder-quobyte-fd8e5336-7137-493f-b007-8d5edaf9ad9e" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-fd8e5336-7137-493f-b007-8d5edaf9ad9e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] snapshot: f154ed46-5dad-4eee-bc5b-62935bf23258, volume: fd8e5336-7137-493f-b007-8d5edaf9ad9e, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9f8fe-dcb8-4bb5-9701-6f7d44d9de47]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:14 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 Sep 29 12:04:14 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:15 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258" returned: 0 in 0.617s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b9041fb-a088-48d7-be30-b4877f1238a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f0744c-f911-4d42-bf84-03d14008542c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:15 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 Sep 29 12:04:15 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:15 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6" returned: 0 in 0.567s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:04:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:15 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e Sep 29 12:04:15 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:23 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=79,cinder:SELECT=70,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:04:23 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=66,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:04:26 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e" returned: 0 in 10.228s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6, size 1024.00 MB, duration 10.23 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:04:26 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Converted 1024.00 MB image at 100.11 MB/s Sep 29 12:04:26 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e is being set with open permissions: ugo+rw Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:26 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e Sep 29 12:04:26 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:26 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e" returned: 0 in 0.276s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-fd8e5336-7137-493f-b007-8d5edaf9ad9e" released by "_copy_volume_from_snapshot" :: held 11.812s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Acquiring lock "cinder-quobyte-f154ed46-5dad-4eee-bc5b-62935bf23258" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-f154ed46-5dad-4eee-bc5b-62935bf23258" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Deleting offline snapshot f154ed46-5dad-4eee-bc5b-62935bf23258 of volume 2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] snapshot_file for this snap is: volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfffec96-a345-4b7f-ae3d-fcbc825d91ed]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:26 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 Sep 29 12:04:26 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:26 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258" returned: 0 in 0.415s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b9041fb-a088-48d7-be30-b4877f1238a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:04:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[345470cf-4486-4ff0-9e35-27be6a8c703f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:27 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 Sep 29 12:04:27 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:27 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6" returned: 0 in 0.684s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:27 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 Sep 29 12:04:27 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:28 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258" returned: 0 in 0.615s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:28 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258 Sep 29 12:04:28 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:28 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6.f154ed46-5dad-4eee-bc5b-62935bf23258" returned: 0 in 0.409s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-f154ed46-5dad-4eee-bc5b-62935bf23258" released by "_delete_snapshot" :: held 2.301s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.049s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669f1eac-2078-408f-930c-3ebca6de62c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e', 'volume_size': 2, 'source_volid': '2b9041fb-a088-48d7-be30-b4877f1238a6', 'source_volstatus': 'available'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce042be5-870c-44d1-bd5b-cdd950ddfe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:29 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Volume volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e (fd8e5336-7137-493f-b007-8d5edaf9ad9e): created successfully Sep 29 12:04:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce042be5-870c-44d1-bd5b-cdd950ddfe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Flow 'volume_create_manager' (a6cc5175-f89e-4a0e-9f71-7817b72a9b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:29 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b3159422-c779-4677-955c-57848e061076 tempest-VolumesCloneTest-1661247175 None] Created volume successfully. Sep 29 12:04:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Acquiring lock "cinder-fd8e5336-7137-493f-b007-8d5edaf9ad9e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Lock "cinder-fd8e5336-7137-493f-b007-8d5edaf9ad9e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Acquiring lock "cinder-quobyte-fd8e5336-7137-493f-b007-8d5edaf9ad9e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-fd8e5336-7137-493f-b007-8d5edaf9ad9e" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af517f7-0528-4fa4-aabe-296c90bf2c77]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:30 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e Sep 29 12:04:30 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:31 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e" returned: 0 in 0.514s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:31 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e Sep 29 12:04:31 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:31 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd8e5336-7137-493f-b007-8d5edaf9ad9e" returned: 0 in 0.386s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-fd8e5336-7137-493f-b007-8d5edaf9ad9e" released by "delete_volume" :: held 0.961s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Created reservations ['b8bc1f72-2081-4f70-a2fd-49d9ba35693e', '10e6b558-3dac-4c04-a475-ae2bafa0b02c', '3163bb34-4035-4203-9569-e74d679e643f', '6be3c338-cdf1-4d47-b602-132f2a4482ab'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:31 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:04:31 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:32 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.452s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:32 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:04:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Deleted volume successfully. Sep 29 12:04:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-913ddbb5-11f6-4c34-8713-18ab9cc8b0ef tempest-VolumesCloneTest-1661247175 None] Lock "cinder-fd8e5336-7137-493f-b007-8d5edaf9ad9e-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Acquiring lock "cinder-2b9041fb-a088-48d7-be30-b4877f1238a6-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-2b9041fb-a088-48d7-be30-b4877f1238a6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Acquiring lock "cinder-quobyte-2b9041fb-a088-48d7-be30-b4877f1238a6" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-2b9041fb-a088-48d7-be30-b4877f1238a6" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad476017-bc9c-429e-b600-51f51a89640a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:33 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 Sep 29 12:04:33 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:33 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6" returned: 0 in 0.580s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:33 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6 Sep 29 12:04:33 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d91d25e1-706b-418f-9666-0af53ba9b6d9 tempest-VolumesActionsTest-689240211 None] Acquiring lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" by "attach_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d91d25e1-706b-418f-9666-0af53ba9b6d9 tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" acquired by "attach_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d91d25e1-706b-418f-9666-0af53ba9b6d9 tempest-VolumesActionsTest-689240211 None] Attaching volume a9fd3a75-46fb-4462-97fb-0d5da723c3cc to instance 19ffa375-4e1c-4118-a7bd-598510c9dd10 at mountpoint /dev/vdb on host None. Sep 29 12:04:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d91d25e1-706b-418f-9666-0af53ba9b6d9 tempest-VolumesActionsTest-689240211 None] Attach volume completed successfully. Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d91d25e1-706b-418f-9666-0af53ba9b6d9 tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" released by "attach_volume" :: held 0.169s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:34 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2b9041fb-a088-48d7-be30-b4877f1238a6" returned: 0 in 0.416s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-quobyte-2b9041fb-a088-48d7-be30-b4877f1238a6" released by "delete_volume" :: held 1.120s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Created reservations ['39b990b8-c096-40dd-a709-3b4285920e47', '728397fd-fe1a-4013-a2b0-bc68aa54df1a', '1631d1b9-9193-4681-9a25-e02c988e97cf', 'f20e99c2-ed2c-4115-b6c5-3f4e0f8490a4'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:34 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:04:34 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e722eec-1754-4680-9784-cfa7762ea65c tempest-VolumesActionsTest-689240211 None] Acquiring lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-detach_volume" by "detach_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e722eec-1754-4680-9784-cfa7762ea65c tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8e722eec-1754-4680-9784-cfa7762ea65c tempest-VolumesActionsTest-689240211 None] Detaching volume a9fd3a75-46fb-4462-97fb-0d5da723c3cc from instance 19ffa375-4e1c-4118-a7bd-598510c9dd10. Sep 29 12:04:35 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.724s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:35 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:04:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Deleted volume successfully. Sep 29 12:04:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8bec4c77-12b6-4d03-9d1c-e40849c89a62 tempest-VolumesCloneTest-1661247175 None] Lock "cinder-2b9041fb-a088-48d7-be30-b4877f1238a6-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8e722eec-1754-4680-9784-cfa7762ea65c tempest-VolumesActionsTest-689240211 None] Detach volume completed successfully. Sep 29 12:04:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8e722eec-1754-4680-9784-cfa7762ea65c tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-detach_volume" released by "detach_volume" :: held 0.330s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (ef2a0493-23ba-45e9-a694-187c9b551b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba5e2ba-9a55-4f14-8327-f1ca77792118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba5e2ba-9a55-4f14-8327-f1ca77792118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-987629272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae03efd-a653-4498-9c5e-923bed537104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:39Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e38176-f821-465f-adbd-3bef90f1ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e38176-f821-465f-adbd-3bef90f1ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378e14a5-2210-4ad5-b3bc-831994b44b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378e14a5-2210-4ad5-b3bc-831994b44b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ae03efd-a653-4498-9c5e-923bed537104', 'volume_name': 'volume-8ae03efd-a653-4498-9c5e-923bed537104', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5262d35-73f9-4e0c-a6bc-60a56c411c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5262d35-73f9-4e0c-a6bc-60a56c411c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a18d87-ba80-4ff9-86dd-759861fd1870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:39 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume 8ae03efd-a653-4498-9c5e-923bed537104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ae03efd-a653-4498-9c5e-923bed537104', 'volume_size': 1} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-987629272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae03efd-a653-4498-9c5e-923bed537104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:39Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating volume 8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:04:39 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:04:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:39 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 1073741824 Sep 29 12:04:39 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:40 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 1073741824" returned: 0 in 0.718s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:40 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 Sep 29 12:04:40 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Flow 'volume_create_manager' (62e93f01-221b-43a0-909b-ad716b0f1341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d57f6d3-cddc-4028-89eb-9ea89e221679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d57f6d3-cddc-4028-89eb-9ea89e221679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1701568921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ee1793-5ac0-48fa-83cf-7ab132187172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a58766a95a4f0db4acf90eb7af313a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:40Z,use_quota=True,user_id='c444d09902ee43b3ae87ac9fb19bc5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ddd31-945f-4468-bf39-7fa645caf6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ddd31-945f-4468-bf39-7fa645caf6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b522d37-a2b4-42e3-abf2-3868792ba942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b522d37-a2b4-42e3-abf2-3868792ba942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ee1793-5ac0-48fa-83cf-7ab132187172', 'volume_name': 'volume-a5ee1793-5ac0-48fa-83cf-7ab132187172', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318dc610-4372-4f8e-9e58-db13d7f461f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318dc610-4372-4f8e-9e58-db13d7f461f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e68992a-35b7-490b-b7e7-6254d69eb7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:40 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Volume a5ee1793-5ac0-48fa-83cf-7ab132187172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ee1793-5ac0-48fa-83cf-7ab132187172', 'volume_size': 1} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:40 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104" returned: 0 in 0.486s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1701568921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ee1793-5ac0-48fa-83cf-7ab132187172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a58766a95a4f0db4acf90eb7af313a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:40Z,use_quota=True,user_id='c444d09902ee43b3ae87ac9fb19bc5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Creating volume a5ee1793-5ac0-48fa-83cf-7ab132187172 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:04:40 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a18d87-ba80-4ff9-86dd-759861fd1870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ae03efd-a653-4498-9c5e-923bed537104', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:40 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 1073741824 Sep 29 12:04:40 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8573fab-d733-434e-a0a2-6ea278528015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:40 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume volume-8ae03efd-a653-4498-9c5e-923bed537104 (8ae03efd-a653-4498-9c5e-923bed537104): created successfully Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8573fab-d733-434e-a0a2-6ea278528015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:40 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (ef2a0493-23ba-45e9-a694-187c9b551b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f88f047b-d128-4c17-b179-b15ab1ebcd22 tempest-VolumesSnapshotTestJSON-1514898417 None] Created volume successfully. Sep 29 12:04:41 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 1073741824" returned: 0 in 0.735s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:41 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 Sep 29 12:04:41 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:42 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172" returned: 0 in 0.417s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e68992a-35b7-490b-b7e7-6254d69eb7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ee1793-5ac0-48fa-83cf-7ab132187172', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fff5a7b-2c8b-41c2-9c29-305be2b7c13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:42 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Volume volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 (a5ee1793-5ac0-48fa-83cf-7ab132187172): created successfully Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fff5a7b-2c8b-41c2-9c29-305be2b7c13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Flow 'volume_create_manager' (62e93f01-221b-43a0-909b-ad716b0f1341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e2aece5b-5b4e-412b-a2fd-03350dcc81ce tempest-TestMinimumBasicScenario-1478726103 None] Created volume successfully. Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating offline snapshot 8c7dfda6-a8be-409d-a830-567acb998733 of volume 8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[63402f2b-79bf-49f5-a418-af38c352f6fe]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:42 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 Sep 29 12:04:42 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:42 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104" returned: 0 in 0.601s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:43 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 1G Sep 29 12:04:43 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:43 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 1G" returned: 0 in 0.612s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ae03efd-a653-4498-9c5e-923bed537104 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:43 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ae03efd-a653-4498-9c5e-923bed537104 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 Sep 29 12:04:43 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:44 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ae03efd-a653-4498-9c5e-923bed537104 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733" returned: 0 in 0.531s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:44 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 is being set with open permissions: ugo+rw Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-56b2b10f-aa9c-427c-be14-d3c9e6b9f3b5 req-68194655-dc8f-40e0-9724-1ff1af5da809 tempest-TestMinimumBasicScenario-1478726103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:44 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 Sep 29 12:04:44 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Flow 'volume_create_manager' (d24565e1-642c-496f-9e20-20329b14fcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d343a65-7ef8-4416-a43c-7f6aa1ab08a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d343a65-7ef8-4416-a43c-7f6aa1ab08a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1971720695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9951f6f95349ba93232fb716befdba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:44Z,use_quota=True,user_id='a633afd894ac4812b1356d470e4f57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94f6fba-054d-49a7-84aa-38f1a8b00080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94f6fba-054d-49a7-84aa-38f1a8b00080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1675ad34-8b2e-40c5-901c-4ce1bd4e812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:04:44 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733" returned: 0 in 0.290s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:44 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.info Sep 29 12:04:44 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1675ad34-8b2e-40c5-901c-4ce1bd4e812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0', 'volume_name': 'volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01aa28a-6db5-4b0d-8ebe-ecf2c65e93e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01aa28a-6db5-4b0d-8ebe-ecf2c65e93e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4690cca-7bbf-4da0-97cf-7560332d99ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:44 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Volume 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Trying to clone 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:04:44 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.info" returned: 0 in 0.360s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:44 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.info is being set with open permissions: ugo+rw Sep 29 12:04:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:44 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.info Sep 29 12:04:44 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:04:45 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3315ad5-a177-43d2-ad29-bbfa87354394]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:45 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.info" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.921s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a467b3-75a3-436b-aa88-f4a9e2914141]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:45 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD Sep 29 12:04:45 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-805d67eb-2fac-433c-b476-f63dd8956068 tempest-VolumesSnapshotTestJSON-1514898417 None] Create snapshot completed successfully Sep 29 12:04:45 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:04:45 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:45 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a is fetched for user a633afd894ac4812b1356d470e4f57d3. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:04:45 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b613f-9cd3-4139-85f1-f16db4c2c4ed]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ab9175-7aba-4b95-a6ba-7d59f71a472a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:45 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:04:45 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:45 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD Sep 29 12:04:45 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:45 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-8c7dfda6-a8be-409d-a830-567acb998733-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-8c7dfda6-a8be-409d-a830-567acb998733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:46 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.498s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.7b7ca150-10f1-4482-9dc7-bafeb170936fanvjn7fi.img {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:46 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.7b7ca150-10f1-4482-9dc7-bafeb170936fanvjn7fi.img Sep 29 12:04:46 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-8ae03efd-a653-4498-9c5e-923bed537104" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-8ae03efd-a653-4498-9c5e-923bed537104" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-8c7dfda6-a8be-409d-a830-567acb998733" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-8c7dfda6-a8be-409d-a830-567acb998733" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Deleting offline snapshot 8c7dfda6-a8be-409d-a830-567acb998733 of volume 8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] snapshot_file for this snap is: volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[53789f1c-c4f0-47c8-95e2-bf09412f4335]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:46 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 Sep 29 12:04:46 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:46 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733" returned: 0 in 0.696s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ae03efd-a653-4498-9c5e-923bed537104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:04:47 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5b716e-0675-4ab3-adc9-e665d6347948]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:47 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 Sep 29 12:04:47 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:47 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104" returned: 0 in 0.930s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:48 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 Sep 29 12:04:48 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:48 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733" returned: 0 in 0.722s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:48 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733 Sep 29 12:04:48 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:49 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104.8c7dfda6-a8be-409d-a830-567acb998733" returned: 0 in 0.521s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-8c7dfda6-a8be-409d-a830-567acb998733" released by "_delete_snapshot" :: held 3.123s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-8ae03efd-a653-4498-9c5e-923bed537104" released by "delete_snapshot" :: held 3.157s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:49 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['3b19c30c-a769-4309-b699-984c86f79583', 'babf219f-79de-48d0-a4a8-7df5cea94dd2', '8cdba34b-ff84-4e80-988f-3bd2862d9513', '316c6943-c0c2-4a05-a899-6abd07c146e3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:04:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Delete snapshot completed successfully. Sep 29 12:04:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b20ca64b-adc5-4536-94a8-2d5bd8ec73f5 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-8c7dfda6-a8be-409d-a830-567acb998733-delete_snapshot" released by "delete_snapshot" :: held 3.551s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (2e7b7ca1-8428-4ab3-bb1a-6c7a139d7a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e14188-f24c-43f7-8285-e73b7e2e3399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e14188-f24c-43f7-8285-e73b7e2e3399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1182396588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fef5c8-83ce-4d12-9e18-be99c59ebe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:51Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02f8f46-691b-4bb1-addf-b7f111e36952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02f8f46-691b-4bb1-addf-b7f111e36952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6f7c07-d6c4-4f67-a69a-7ab51258b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6f7c07-d6c4-4f67-a69a-7ab51258b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fef5c8-83ce-4d12-9e18-be99c59ebe8b', 'volume_name': 'volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8161a65b-2f11-4996-8e5c-2b692eb98db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8161a65b-2f11-4996-8e5c-2b692eb98db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e889d83-19f3-47fa-8bd3-83001d606815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:04:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Volume 45fef5c8-83ce-4d12-9e18-be99c59ebe8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b', 'volume_size': 1} Sep 29 12:04:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:04:53 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.7b7ca150-10f1-4482-9dc7-bafeb170936fanvjn7fi.img" returned: 0 in 6.960s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:53 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f3e352-55ae-40be-8c8d-400157d69e83]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:04:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:04:53 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:04:53 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:04:53 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 29 12:04:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.503s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:04:53 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.7b7ca150-10f1-4482-9dc7-bafeb170936fanvjn7fi.img {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:04:53 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Converted 1024.00 MB image at 147.12 MB/s Sep 29 12:04:53 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] 7b7ca150-10f1-4482-9dc7-bafeb170936f was raw, no need to convert to raw {{(pid=86117) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 12:05:03 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=32,cinder:SELECT=39,cinder:INSERT=10 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:05:03 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=43,cinder:SELECT=46,cinder:DELETE=6,cinder:INSERT=9 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.394s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Uploaded volume to glance image-id: 7b7ca150-10f1-4482-9dc7-bafeb170936f. {{(pid=86117) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-56b2b10f-aa9c-427c-be14-d3c9e6b9f3b5 req-68194655-dc8f-40e0-9724-1ff1af5da809 tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 27.428s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-56b2b10f-aa9c-427c-be14-d3c9e6b9f3b5 req-68194655-dc8f-40e0-9724-1ff1af5da809 tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.601s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1971720695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9951f6f95349ba93232fb716befdba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:44Z,use_quota=True,user_id='a633afd894ac4812b1356d470e4f57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Creating volume 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:05:11 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d17d415f-2374-4560-85b8-df7161453e40 tempest-VolumesActionsTest-689240211 None] Copy volume to image completed successfully. Sep 29 12:05:11 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 1073741824 Sep 29 12:05:11 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-56b2b10f-aa9c-427c-be14-d3c9e6b9f3b5 req-68194655-dc8f-40e0-9724-1ff1af5da809 tempest-TestMinimumBasicScenario-1478726103 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-a5ee1793-5ac0-48fa-83cf-7ab132187172', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5eabb43-dfa8-487b-ba48-8dc3250c9464', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:05:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-56b2b10f-aa9c-427c-be14-d3c9e6b9f3b5 req-68194655-dc8f-40e0-9724-1ff1af5da809 tempest-TestMinimumBasicScenario-1478726103 None] attachment_update completed successfully. Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:12 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:05:12 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:12 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 1073741824" returned: 0 in 0.512s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:12 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 Sep 29 12:05:12 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:12 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.271s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:05:12 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" returned: 0 in 0.276s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.924s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1182396588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fef5c8-83ce-4d12-9e18-be99c59ebe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:04:51Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Creating volume 45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:05:12 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:12 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b 1073741824 Sep 29 12:05:12 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Attempting download of 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac7d0d7-8b1a-4415-88a0-da4d805b2326]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_fav160wu {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:12 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_fav160wu Sep 29 12:05:12 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:13 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_fav160wu" returned: 0 in 0.430s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_fav160wu {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:13 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b 1073741824" returned: 0 in 0.564s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:13 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b Sep 29 12:05:13 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:13 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_fav160wu Sep 29 12:05:13 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:13 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" returned: 0 in 0.284s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:13 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e889d83-19f3-47fa-8bd3-83001d606815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab150492-e00a-4b3b-9d0e-5a3df21162b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_fav160wu" returned: 1 in 0.370s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_fav160wu' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acb0084-2f1c-4f0c-b5e0-93ca2d4f48bc]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Volume volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b (45fef5c8-83ce-4d12-9e18-be99c59ebe8b): created successfully Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab150492-e00a-4b3b-9d0e-5a3df21162b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (2e7b7ca1-8428-4ab3-bb1a-6c7a139d7a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-46e69d29-bb54-428e-a494-2113385f5b8b tempest-VolumesSnapshotTestJSON-1514898417 None] Created volume successfully. Sep 29 12:05:13 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD Sep 29 12:05:13 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8554ef80-56e1-4b2b-9739-94aba136e9c3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:13 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] 2eff10fc-36b0-4954-8584-fe8c9e38eb2a was qcow2, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:05:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:13 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 Sep 29 12:05:13 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:13 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:05:13 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:14 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.501s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:14 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f8b89f-1136-401c-9789-62ec5a2706f3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:14 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:05:14 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:14 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.542s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:14 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img Sep 29 12:05:14 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:17 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" returned: 0 in 4.072s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:17 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_0gjg0rbfdevstack@QuobyteHD, size 112.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:05:17 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Converted 112.00 MB image at 27.49 MB/s Sep 29 12:05:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:17 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 1G Sep 29 12:05:17 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:18 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 1G" returned: 0 in 0.770s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Downloaded image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a for user a633afd894ac4812b1356d470e4f57d3 is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Marking volume 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Copying metadata from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a to 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Creating volume glance metadata for volume 8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 backed by image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4690cca-7bbf-4da0-97cf-7560332d99ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a67fbc-9915-48d4-9824-d2da6e54ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:18 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Volume volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 (8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0): created successfully Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a67fbc-9915-48d4-9824-d2da6e54ede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Flow 'volume_create_manager' (d24565e1-642c-496f-9e20-20329b14fcb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-369dd5c2-fce5-4efd-9384-ea13983db611 tempest-VolumesExtendTest-1323900741 None] Created volume successfully. Sep 29 12:05:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:23 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img" returned: 0 in 8.247s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eccec6-d895-4fd1-9444-3743c4a920f4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:23 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:05:23 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:23 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.598s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:05:23 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Converted 1024.00 MB image at 124.15 MB/s Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] d4ce9dfb-8471-4ed3-9d2a-45a500804089 was raw, converting to qcow2 {{(pid=86117) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4da702-3a4f-4c3b-b9ce-77dfb4b15523]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:23 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img Sep 29 12:05:23 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:24 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img" returned: 0 in 0.370s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:24 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img Sep 29 12:05:24 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:24 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img" returned: 1 in 0.363s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img /opt/stack/data/cinder/conversion/vol_upload_6pbzjx_8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:24 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img /opt/stack/data/cinder/conversion/vol_upload_6pbzjx_8 Sep 29 12:05:24 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:24 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img /opt/stack/data/cinder/conversion/vol_upload_6pbzjx_8" returned: 0 in 0.273s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Image conversion details: src /opt/stack/data/cinder/conversion/a9fd3a75-46fb-4462-97fb-0d5da723c3cc.temp_image.d4ce9dfb-8471-4ed3-9d2a-45a50080408902c9qo6x.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6pbzjx_8 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:05:24 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0424cb-ad1b-469a-851e-0bb880ad4802]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6pbzjx_8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:24 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6pbzjx_8 Sep 29 12:05:24 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:25 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6pbzjx_8" returned: 0 in 0.340s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.605s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Uploaded volume to glance image-id: d4ce9dfb-8471-4ed3-9d2a-45a500804089. {{(pid=86117) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.933s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Creating offline snapshot f2feddaf-edf6-49f6-bd86-52cd83730136 of volume 45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:05:26 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4f15f004-9dbe-472a-b346-a113b17bffdf tempest-VolumesActionsTest-689240211 None] Copy volume to image completed successfully. Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a32a4bb-77a0-476b-b3e5-bbb2c097eca8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:26 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b Sep 29 12:05:26 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:26 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" returned: 0 in 0.536s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:26 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 1G Sep 29 12:05:26 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Acquiring lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Acquiring lock "cinder-quobyte-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Lock "cinder-quobyte-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d717a36-de0c-4359-a510-efa856a91ab6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:27 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 1G" returned: 0 in 0.502s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:27 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 Sep 29 12:05:27 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:27 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:05:27 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:27 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136" returned: 0 in 0.295s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:27 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 is being set with open permissions: ugo+rw Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:27 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.407s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:27 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 Sep 29 12:05:27 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:27 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc Sep 29 12:05:27 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:27 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136" returned: 0 in 0.272s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:27 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" returned: 0 in 0.262s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Lock "cinder-quobyte-a9fd3a75-46fb-4462-97fb-0d5da723c3cc" released by "delete_volume" :: held 0.716s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:28 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.info Sep 29 12:05:28 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Created reservations ['e2d1cbed-49c8-48b9-b8be-52473162ec69', '30df6ccd-f1f4-4ae8-8503-2438583d44b4', 'fb6137e9-c41c-4f70-a39e-8805253702d9', 'f850b44f-8438-4758-8e0a-96fb7c62d504'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:28 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:05:28 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:28 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.info" returned: 0 in 0.292s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:28 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.info is being set with open permissions: ugo+rw Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:28 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.info Sep 29 12:05:28 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:28 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.280s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:05:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Deleted volume successfully. Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-608af9f7-44ed-40fb-929d-fa04d83a7e80 tempest-VolumesActionsTest-689240211 None] Lock "cinder-a9fd3a75-46fb-4462-97fb-0d5da723c3cc-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:28 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.info" returned: 0 in 0.295s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 8.581s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb76b4-b6f0-483e-85e2-b8e454526fb3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f80b7346-825f-4209-9595-901381ddfecd tempest-VolumesSnapshotTestJSON-1514898417 None] Create snapshot completed successfully Sep 29 12:05:28 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 Sep 29 12:05:28 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:29 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" returned: 0 in 0.454s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 2G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 2G" returned: 0 in 0.172s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:29 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a0d06167-0bf9-4d3f-810a-68dac92c223f tempest-VolumesExtendTest-1323900741 None] Extend volume completed successfully. Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (ca2633ae-95d0-4b38-9ddf-2785c1b884fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b3de3-eab7-4fb0-ac25-58dfb7a89682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b3de3-eab7-4fb0-ac25-58dfb7a89682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1547369206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841ae6f1-0ef9-4efe-a2e8-27b211904edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:05:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f2feddaf-edf6-49f6-bd86-52cd83730136,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:05:30Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad9419c-5523-44a6-a669-c70a824ee725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad9419c-5523-44a6-a669-c70a824ee725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e0a13b-0372-4c07-a195-050bd64cc2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e0a13b-0372-4c07-a195-050bd64cc2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '841ae6f1-0ef9-4efe-a2e8-27b211904edf', 'volume_name': 'volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf', 'volume_size': 2, 'snapshot_id': 'f2feddaf-edf6-49f6-bd86-52cd83730136'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93606365-9f44-4636-b2d2-125a3910cb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93606365-9f44-4636-b2d2-125a3910cb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb44f7a-f29f-4333-8a05-485a436624a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume 841ae6f1-0ef9-4efe-a2e8-27b211904edf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf', 'volume_size': 2, 'snapshot_id': 'f2feddaf-edf6-49f6-bd86-52cd83730136'} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-f2feddaf-edf6-49f6-bd86-52cd83730136-841ae6f1-0ef9-4efe-a2e8-27b211904edf" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-f2feddaf-edf6-49f6-bd86-52cd83730136-841ae6f1-0ef9-4efe-a2e8-27b211904edf" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating volume 841ae6f1-0ef9-4efe-a2e8-27b211904edf from snapshot f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-841ae6f1-0ef9-4efe-a2e8-27b211904edf" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-841ae6f1-0ef9-4efe-a2e8-27b211904edf" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] snapshot: f2feddaf-edf6-49f6-bd86-52cd83730136, volume: 841ae6f1-0ef9-4efe-a2e8-27b211904edf, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cdc338-59ed-4cd2-b870-771c32644b85]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:30 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 Sep 29 12:05:30 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Acquiring lock "cinder-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Lock "cinder-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Acquiring lock "cinder-quobyte-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d817f4-bb6a-4a85-9eab-71d6ee367e22]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:30 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136" returned: 0 in 0.664s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf30612-8de3-4dd3-9757-9111e9a2fe05]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:31 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 Sep 29 12:05:31 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:31 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b Sep 29 12:05:31 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:31 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" returned: 0 in 0.529s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:31 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0 Sep 29 12:05:31 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:31 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" returned: 0 in 0.514s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:31 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf Sep 29 12:05:31 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:31 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" returned: 0 in 0.320s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0" released by "delete_volume" :: held 0.950s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Created reservations ['6ea46348-b8a1-4423-81d3-f8c322077708', '0f21768e-6397-4675-867d-fa406a3cf713', '89615dce-e91e-42d7-a804-36275aaec9ec', 'b8af1378-c3d0-49fb-8fcb-e3ca483dbdcd'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:32 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:05:32 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:32 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.744s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:32 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:05:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Deleted volume successfully. Sep 29 12:05:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f2ceda4f-280f-428e-993a-a61aa506b0ff tempest-VolumesExtendTest-1323900741 None] Lock "cinder-8aee2b0a-bd86-4625-a6cf-1d60fbaae3a0-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Flow 'volume_create_manager' (84dd92ad-98f7-48a2-946f-86799dea2e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ef6df3-ca9f-4868-bb98-66e62a621eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ef6df3-ca9f-4868-bb98-66e62a621eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1443765533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32d8579-21aa-4c68-a4f0-a26a79a344d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9951f6f95349ba93232fb716befdba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:05:34Z,use_quota=True,user_id='a633afd894ac4812b1356d470e4f57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2903a56-58fe-4c39-ae31-e7511ebce4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2903a56-58fe-4c39-ae31-e7511ebce4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955a7d52-da79-4170-8be3-046649ca0669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955a7d52-da79-4170-8be3-046649ca0669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32d8579-21aa-4c68-a4f0-a26a79a344d3', 'volume_name': 'volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f902b88-08df-4560-964d-9d72f45be3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f902b88-08df-4560-964d-9d72f45be3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16122e2-9e06-492b-94ad-5cb5ad22f619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:33 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Volume f32d8579-21aa-4c68-a4f0-a26a79a344d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3', 'volume_size': 1} Sep 29 12:05:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:41 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf" returned: 0 in 10.213s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:41 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b, size 1024.00 MB, duration 10.21 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:05:41 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Converted 1024.00 MB image at 100.25 MB/s Sep 29 12:05:41 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf is being set with open permissions: ugo+rw Sep 29 12:05:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:41 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf Sep 29 12:05:41 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:42 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-841ae6f1-0ef9-4efe-a2e8-27b211904edf" released by "_copy_volume_from_snapshot" :: held 11.805s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-f2feddaf-edf6-49f6-bd86-52cd83730136-841ae6f1-0ef9-4efe-a2e8-27b211904edf" released by "_create_volume_from_snapshot" :: held 11.896s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.930s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.235s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1443765533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32d8579-21aa-4c68-a4f0-a26a79a344d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9951f6f95349ba93232fb716befdba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:05:34Z,use_quota=True,user_id='a633afd894ac4812b1356d470e4f57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Creating volume f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:05:42 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb44f7a-f29f-4333-8a05-485a436624a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf', 'volume_size': 2, 'snapshot_id': 'f2feddaf-edf6-49f6-bd86-52cd83730136'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:42 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 1073741824 Sep 29 12:05:42 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa1e552-7ca1-42a8-9bf3-bba148cf9891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:42 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf (841ae6f1-0ef9-4efe-a2e8-27b211904edf): created successfully Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa1e552-7ca1-42a8-9bf3-bba148cf9891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (ca2633ae-95d0-4b38-9ddf-2785c1b884fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9d6be942-2448-4439-87d2-a7655d142423 tempest-VolumesSnapshotTestJSON-1514898417 None] Created volume successfully. Sep 29 12:05:42 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 1073741824" returned: 0 in 0.595s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-841ae6f1-0ef9-4efe-a2e8-27b211904edf-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-841ae6f1-0ef9-4efe-a2e8-27b211904edf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:42 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 Sep 29 12:05:42 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-841ae6f1-0ef9-4efe-a2e8-27b211904edf" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-841ae6f1-0ef9-4efe-a2e8-27b211904edf" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5f04d-1198-4705-9bff-f7ee522958a5]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Flow 'volume_create_manager' (448f05ab-1638-4c80-81cd-f699416c78a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f8e1ce-f29f-4e02-9a1f-184f8de99882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f8e1ce-f29f-4e02-9a1f-184f8de99882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2093198145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a524e69-5b84-493d-9bcb-d1c74b5e0e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5090737de443d59419ff408d9d1689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:05:43Z,use_quota=True,user_id='6eed55cddb134ba593647626b80e6aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:43 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f538ad-b114-409d-a743-c6025973fb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:43 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf Sep 29 12:05:43 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f538ad-b114-409d-a743-c6025973fb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2265da10-2952-4b71-8a87-d99c4b163591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2265da10-2952-4b71-8a87-d99c4b163591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a524e69-5b84-493d-9bcb-d1c74b5e0e8b', 'volume_name': 'volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f567b85-5193-4081-8e65-06d8db9b1105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f567b85-5193-4081-8e65-06d8db9b1105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0190ff1e-cc3e-46b2-b9c8-683e92301c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:43 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Volume 7a524e69-5b84-493d-9bcb-d1c74b5e0e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b', 'volume_size': 1} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3" returned: 0 in 0.409s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2093198145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a524e69-5b84-493d-9bcb-d1c74b5e0e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5090737de443d59419ff408d9d1689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:05:43Z,use_quota=True,user_id='6eed55cddb134ba593647626b80e6aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Creating volume 7a524e69-5b84-493d-9bcb-d1c74b5e0e8b {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:05:43 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16122e2-9e06-492b-94ad-5cb5ad22f619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9257bca-f7f4-452e-82cd-a4ed95340819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:43 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b 1073741824 Sep 29 12:05:43 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:43 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Volume volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 (f32d8579-21aa-4c68-a4f0-a26a79a344d3): created successfully Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9257bca-f7f4-452e-82cd-a4ed95340819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Flow 'volume_create_manager' (84dd92ad-98f7-48a2-946f-86799dea2e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2b94d8e3-53d1-4339-8ede-5bd91aa8748c tempest-VolumesExtendTest-1323900741 None] Created volume successfully. Sep 29 12:05:43 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf" returned: 0 in 0.511s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:43 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf Sep 29 12:05:43 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:43 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-841ae6f1-0ef9-4efe-a2e8-27b211904edf" returned: 0 in 0.347s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:43 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b 1073741824" returned: 0 in 0.668s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-841ae6f1-0ef9-4efe-a2e8-27b211904edf" released by "delete_volume" :: held 0.953s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:44 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b Sep 29 12:05:44 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['21548044-0908-445e-965a-edbbfeef290b', '4d9e017c-bdd6-453e-82a6-2cd30e163f45', 'd0d01941-607c-4b4b-a3d4-75edee4c6e98', '17c5def4-cbe2-4743-b04b-b2f1eb0f4d6c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:44 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:05:44 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:44 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b" returned: 0 in 0.273s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.315s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0190ff1e-cc3e-46b2-b9c8-683e92301c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cbd206-26a2-43ec-945c-04881b8d63dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Creating offline snapshot b71ce78b-4ba9-4f7a-ad05-4b203325461a of volume f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:05:44 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Volume volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b (7a524e69-5b84-493d-9bcb-d1c74b5e0e8b): created successfully Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cbd206-26a2-43ec-945c-04881b8d63dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Flow 'volume_create_manager' (448f05ab-1638-4c80-81cd-f699416c78a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ce66b-ce3e-4244-b265-e743b92a195e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-80794a72-f777-4f7a-98e9-a809216ff2aa tempest-VolumesNegativeTest-1242014623 None] Created volume successfully. Sep 29 12:05:44 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.264s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:05:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Deleted volume successfully. Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6c767985-0f75-455a-91bf-3c5f11bf5135 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-841ae6f1-0ef9-4efe-a2e8-27b211904edf-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:44 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 Sep 29 12:05:44 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:44 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3" returned: 0 in 0.380s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:44 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a 1G Sep 29 12:05:44 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:45 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a 1G" returned: 0 in 0.437s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:45 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a Sep 29 12:05:45 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-f2feddaf-edf6-49f6-bd86-52cd83730136-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-f2feddaf-edf6-49f6-bd86-52cd83730136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-f2feddaf-edf6-49f6-bd86-52cd83730136" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-f2feddaf-edf6-49f6-bd86-52cd83730136" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Deleting offline snapshot f2feddaf-edf6-49f6-bd86-52cd83730136 of volume 45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] snapshot_file for this snap is: volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc15d40-7309-4eb5-ad5c-2a9d5c07aad4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:45 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 Sep 29 12:05:45 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:45 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a" returned: 0 in 0.379s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:45 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a is being set with open permissions: ugo+rw Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:45 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a Sep 29 12:05:45 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:45 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136" returned: 0 in 0.421s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97e46d2-7ced-4bde-ac85-9eab5dcdd2f0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:45 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a" returned: 0 in 0.311s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:45 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.info Sep 29 12:05:45 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:45 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b Sep 29 12:05:45 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:46 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.info" returned: 0 in 0.283s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:46 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.info is being set with open permissions: ugo+rw Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:46 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.info Sep 29 12:05:46 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:46 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:46 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" returned: 0 in 0.673s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.info" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:46 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 Sep 29 12:05:46 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:46 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9cdecce5-0b30-43b9-99ce-bb2623fe9628 tempest-VolumesExtendTest-1323900741 None] Create snapshot completed successfully Sep 29 12:05:46 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136" returned: 0 in 0.419s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:46 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136 Sep 29 12:05:46 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f996352-c18e-4f4d-a5a8-b50922d710a2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:47 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b.f2feddaf-edf6-49f6-bd86-52cd83730136" returned: 0 in 0.388s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-f2feddaf-edf6-49f6-bd86-52cd83730136" released by "_delete_snapshot" :: held 2.082s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:47 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 Sep 29 12:05:47 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" released by "delete_snapshot" :: held 2.110s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['3958c457-c054-47dd-a48d-393bbfd050f5', 'e1423ca8-8bfe-46f5-a349-fb306df0c803', '7f6e1cba-878a-4cd6-99b4-8baef6479357', '5be62950-d9f3-4eb6-b9c7-f6bca9db091a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:05:47 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Delete snapshot completed successfully. Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5879c4c5-bfde-4b9d-a15e-5afd22bd3d70 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-f2feddaf-edf6-49f6-bd86-52cd83730136-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:47 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3" returned: 0 in 0.441s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a 2G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a 2G" returned: 0 in 0.174s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.695s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:47 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-df3e6787-bc93-4094-a0c3-e1f63fc97561 tempest-VolumesExtendTest-1323900741 None] Extend volume completed successfully. Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "cinder-b71ce78b-4ba9-4f7a-ad05-4b203325461a-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-b71ce78b-4ba9-4f7a-ad05-4b203325461a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "cinder-quobyte-f32d8579-21aa-4c68-a4f0-a26a79a344d3" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-f32d8579-21aa-4c68-a4f0-a26a79a344d3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "cinder-quobyte-b71ce78b-4ba9-4f7a-ad05-4b203325461a" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-45fef5c8-83ce-4d12-9e18-be99c59ebe8b-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-b71ce78b-4ba9-4f7a-ad05-4b203325461a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Deleting offline snapshot b71ce78b-4ba9-4f7a-ad05-4b203325461a of volume f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] snapshot_file for this snap is: volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-45fef5c8-83ce-4d12-9e18-be99c59ebe8b-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1376d3-92fb-4167-aa0d-6b3a9077a651]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd557529-d673-489f-a8fb-2b3a0384541d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:48 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a Sep 29 12:05:48 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:48 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b Sep 29 12:05:48 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:49 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a" returned: 0 in 0.452s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e92478-e91c-4748-9e03-e03c06f3d4fb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:49 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" returned: 0 in 0.454s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:49 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 Sep 29 12:05:49 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:49 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b Sep 29 12:05:49 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:49 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" returned: 0 in 0.345s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:49 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3" returned: 0 in 0.490s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-45fef5c8-83ce-4d12-9e18-be99c59ebe8b" released by "delete_volume" :: held 0.900s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:49 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a Sep 29 12:05:49 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['c01945dd-894c-4769-8e3d-150fcbe94948', '3a644c01-96cb-4ae8-869c-952ee65bd08d', 'e1bcf048-378b-4990-a680-94a7f42a6604', '1c503c5f-1bda-4709-9e4e-01968ef86e00'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:49 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:05:49 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:50 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a" returned: 0 in 0.478s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:50 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.305s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:05:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Deleted volume successfully. Sep 29 12:05:50 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a Sep 29 12:05:50 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0e6cf9de-a4c5-441d-a533-5a1015b7a6ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-45fef5c8-83ce-4d12-9e18-be99c59ebe8b-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:50 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3.b71ce78b-4ba9-4f7a-ad05-4b203325461a" returned: 0 in 0.271s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-b71ce78b-4ba9-4f7a-ad05-4b203325461a" released by "_delete_snapshot" :: held 1.866s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-f32d8579-21aa-4c68-a4f0-a26a79a344d3" released by "delete_snapshot" :: held 1.910s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Created reservations ['e3b0e3eb-f96f-4ffe-a2ce-2e3857b118f5', '25ec1e47-0276-4c6c-b123-8d948c86ef52', '08e112d9-b719-4c03-aa15-639a78169ecd', '8e060750-f9f5-4f54-a52f-53ee7d996d10'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:05:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Delete snapshot completed successfully. Sep 29 12:05:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9569de5e-8c3e-4d26-8eda-a4cdef128631 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-b71ce78b-4ba9-4f7a-ad05-4b203325461a-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "cinder-f32d8579-21aa-4c68-a4f0-a26a79a344d3-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-f32d8579-21aa-4c68-a4f0-a26a79a344d3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "cinder-quobyte-f32d8579-21aa-4c68-a4f0-a26a79a344d3" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:05:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-f32d8579-21aa-4c68-a4f0-a26a79a344d3" acquired by "delete_volume" :: waited 0.061s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:05:51 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf031b-fd38-44aa-8d89-c676f3e1823f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:51 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 Sep 29 12:05:51 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (0b417645-8210-401c-8001-21ca33436632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a2eb03-12d9-40e2-9386-3d444d93f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a2eb03-12d9-40e2-9386-3d444d93f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-893991914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a60ef-55da-482e-91b6-17283dab6353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:05:52Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507fdbd3-00dc-4c84-a7f1-61ffd56af539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507fdbd3-00dc-4c84-a7f1-61ffd56af539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3028ee36-0cf1-4ca7-b619-fc83560c8c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3028ee36-0cf1-4ca7-b619-fc83560c8c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2a60ef-55da-482e-91b6-17283dab6353', 'volume_name': 'volume-fd2a60ef-55da-482e-91b6-17283dab6353', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755f3a2f-37a4-4504-9de3-6589fd36e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755f3a2f-37a4-4504-9de3-6589fd36e71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226f0332-7132-4187-a134-15381d2a048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume fd2a60ef-55da-482e-91b6-17283dab6353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2a60ef-55da-482e-91b6-17283dab6353', 'volume_size': 1} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-893991914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a60ef-55da-482e-91b6-17283dab6353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:05:52Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating volume fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:05:52 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:52 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 1073741824 Sep 29 12:05:52 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:52 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3" returned: 0 in 0.974s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:52 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3 Sep 29 12:05:52 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:52 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f32d8579-21aa-4c68-a4f0-a26a79a344d3" returned: 0 in 0.500s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-quobyte-f32d8579-21aa-4c68-a4f0-a26a79a344d3" released by "delete_volume" :: held 1.676s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Created reservations ['ab0f641d-4aba-4ed2-ab09-1445ad669eb1', '75ad5d57-9419-4573-a13e-18649057584f', 'e288207b-f158-49f3-8a38-f41c466d589d', 'eb3cc139-c6d3-45d5-a446-ea3a107bf445'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:05:53 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 1073741824" returned: 0 in 0.789s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:53 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 Sep 29 12:05:53 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:53 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:05:53 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:53 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353" returned: 0 in 0.300s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226f0332-7132-4187-a134-15381d2a048c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2a60ef-55da-482e-91b6-17283dab6353', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec7d79d-2483-4cf9-9f05-269492f3c152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:05:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume volume-fd2a60ef-55da-482e-91b6-17283dab6353 (fd2a60ef-55da-482e-91b6-17283dab6353): created successfully Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec7d79d-2483-4cf9-9f05-269492f3c152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (0b417645-8210-401c-8001-21ca33436632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-34a4665c-459c-4339-aae4-21bb1ecbfe87 tempest-VolumesSnapshotTestJSON-1514898417 None] Created volume successfully. Sep 29 12:05:53 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.423s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:05:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Deleted volume successfully. Sep 29 12:05:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-82b844c4-9c71-4c4b-9c89-53053a14d904 tempest-VolumesExtendTest-1323900741 None] Lock "cinder-f32d8579-21aa-4c68-a4f0-a26a79a344d3-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:05:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:05:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:05:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating offline snapshot 7031894e-a68c-4d2e-9dc8-63fb08477613 of volume fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:05:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0c10b3-70dc-4ec2-910d-666e7830e078]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:05:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:54 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 Sep 29 12:05:54 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:55 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353" returned: 0 in 0.492s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:55 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 1G Sep 29 12:05:55 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:55 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 1G" returned: 0 in 0.726s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a60ef-55da-482e-91b6-17283dab6353 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:55 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a60ef-55da-482e-91b6-17283dab6353 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 Sep 29 12:05:55 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:56 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a60ef-55da-482e-91b6-17283dab6353 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613" returned: 0 in 0.448s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:56 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 is being set with open permissions: ugo+rw Sep 29 12:05:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:56 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 Sep 29 12:05:56 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:56 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613" returned: 0 in 0.416s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:56 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.info Sep 29 12:05:56 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:57 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.info" returned: 0 in 0.581s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:57 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.info is being set with open permissions: ugo+rw Sep 29 12:05:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:05:57 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.info Sep 29 12:05:57 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:05:57 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 29 12:05:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.info" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:05:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.168s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:05:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6c7c9f25-d3a2-47d8-a99c-b76ab61f2428 tempest-VolumesSnapshotTestJSON-1514898417 None] Create snapshot completed successfully Sep 29 12:05:59 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:05:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (7647a650-7fb4-4f37-8c86-e70042cb39bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:05:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b4572-8acf-4077-8b34-281d3b68226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b4572-8acf-4077-8b34-281d3b68226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2112304577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c47bf0-98a0-4682-8504-4612bb688890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3664bf5ff4af4f2a9b86071577c8c4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7031894e-a68c-4d2e-9dc8-63fb08477613,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:00Z,use_quota=True,user_id='533017b9a99243658a5b5d0967970430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0047dff-0724-4afe-9d3f-f3f972872892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0047dff-0724-4afe-9d3f-f3f972872892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16075359-d1b0-481f-8665-551bbb9a4956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16075359-d1b0-481f-8665-551bbb9a4956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51c47bf0-98a0-4682-8504-4612bb688890', 'volume_name': 'volume-51c47bf0-98a0-4682-8504-4612bb688890', 'volume_size': 1, 'snapshot_id': '7031894e-a68c-4d2e-9dc8-63fb08477613'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2295b0d3-87f0-41df-ba9c-81a858d503cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2295b0d3-87f0-41df-ba9c-81a858d503cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6fdc27-2cc4-4394-9131-240133a6a5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume 51c47bf0-98a0-4682-8504-4612bb688890: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51c47bf0-98a0-4682-8504-4612bb688890', 'volume_size': 1, 'snapshot_id': '7031894e-a68c-4d2e-9dc8-63fb08477613'} Sep 29 12:06:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-f98e2b8d-27eb-4f24-83a6-a81da8c3ef40 req-676b0fdd-da78-4cca-96d6-88afe2bb32be tempest-TestMinimumBasicScenario-1478726103 None] Terminate volume connection completed successfully. Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-f98e2b8d-27eb-4f24-83a6-a81da8c3ef40 req-676b0fdd-da78-4cca-96d6-88afe2bb32be tempest-TestMinimumBasicScenario-1478726103 None] Deleting attachment b5eabb43-dfa8-487b-ba48-8dc3250c9464. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-7031894e-a68c-4d2e-9dc8-63fb08477613-51c47bf0-98a0-4682-8504-4612bb688890" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-7031894e-a68c-4d2e-9dc8-63fb08477613-51c47bf0-98a0-4682-8504-4612bb688890" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating volume 51c47bf0-98a0-4682-8504-4612bb688890 from snapshot 7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-51c47bf0-98a0-4682-8504-4612bb688890" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-51c47bf0-98a0-4682-8504-4612bb688890" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] snapshot: 7031894e-a68c-4d2e-9dc8-63fb08477613, volume: 51c47bf0-98a0-4682-8504-4612bb688890, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[17539eb4-55c7-4e46-b4b5-ea93223f09a1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:00 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 Sep 29 12:06:00 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:00 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613" returned: 0 in 0.483s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2a60ef-55da-482e-91b6-17283dab6353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d6d64a-51b1-471b-a3ac-21143672a99e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:00 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 Sep 29 12:06:00 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:01 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353" returned: 0 in 0.432s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:01 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 Sep 29 12:06:01 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Acquiring lock "cinder-a5ee1793-5ac0-48fa-83cf-7ab132187172-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Lock "cinder-a5ee1793-5ac0-48fa-83cf-7ab132187172-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Acquiring lock "cinder-quobyte-a5ee1793-5ac0-48fa-83cf-7ab132187172" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Lock "cinder-quobyte-a5ee1793-5ac0-48fa-83cf-7ab132187172" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7e7954-f428-4bc1-bbb1-e0c88a4c7b90]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:01 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 Sep 29 12:06:01 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:02 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172" returned: 0 in 0.729s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:02 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172 Sep 29 12:06:02 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:03 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5ee1793-5ac0-48fa-83cf-7ab132187172" returned: 0 in 0.789s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Lock "cinder-quobyte-a5ee1793-5ac0-48fa-83cf-7ab132187172" released by "delete_volume" :: held 1.599s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Created reservations ['5c70ec67-6589-410b-a893-b96a93cdb611', '58555248-556c-4818-9f4e-1ff1816fb6eb', 'd0f83c55-39fc-4525-9167-ca44290bb12e', 'c98b1fda-88a5-4600-ac57-5006e4f052f8'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:03 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:03 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:04 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.792s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:04 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:04 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Deleted volume successfully. Sep 29 12:06:04 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=86,cinder:SELECT=80,cinder:DELETE=9,cinder:INSERT=27 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:06:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8187799f-477a-40f1-9a86-e0b1614a3493 tempest-TestMinimumBasicScenario-1478726103 None] Lock "cinder-a5ee1793-5ac0-48fa-83cf-7ab132187172-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=88,cinder:UPDATE=94,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Flow 'volume_create_manager' (e9a9b720-2a20-4357-98f3-ae8a8480cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b88263c-cd08-4a96-945b-779eb46aef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b88263c-cd08-4a96-945b-779eb46aef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1868299602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fedd7d-7efe-4df1-ac15-198875d96c8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='207e85984889407b812bfa0f51ee095a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:06Z,use_quota=True,user_id='205016020e0e4ccca82ee257296d8840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc08682-fd7f-4dac-83d8-3d4b0bf63fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc08682-fd7f-4dac-83d8-3d4b0bf63fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f148d8fe-cdc2-4474-91d6-dd942ba90b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f148d8fe-cdc2-4474-91d6-dd942ba90b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fedd7d-7efe-4df1-ac15-198875d96c8d', 'volume_name': 'volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed57bd0-dde0-4bc5-8ea5-95983e4bab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed57bd0-dde0-4bc5-8ea5-95983e4bab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f86f28-083a-486a-b1ff-312b40bdb988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:06 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Volume b9fedd7d-7efe-4df1-ac15-198875d96c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d', 'volume_size': 1} Sep 29 12:06:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:10 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890" returned: 0 in 9.324s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:06:10 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Converted 1024.00 MB image at 109.81 MB/s Sep 29 12:06:10 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 is being set with open permissions: ugo+rw Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:10 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 Sep 29 12:06:10 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:10 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890" returned: 0 in 0.280s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-51c47bf0-98a0-4682-8504-4612bb688890" released by "_copy_volume_from_snapshot" :: held 10.682s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-7031894e-a68c-4d2e-9dc8-63fb08477613-51c47bf0-98a0-4682-8504-4612bb688890" released by "_create_volume_from_snapshot" :: held 10.776s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.795s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.256s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1868299602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fedd7d-7efe-4df1-ac15-198875d96c8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='207e85984889407b812bfa0f51ee095a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:06Z,use_quota=True,user_id='205016020e0e4ccca82ee257296d8840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Creating volume b9fedd7d-7efe-4df1-ac15-198875d96c8d {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:06:10 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:10 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d 1073741824 Sep 29 12:06:10 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6fdc27-2cc4-4394-9131-240133a6a5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c47bf0-98a0-4682-8504-4612bb688890', 'volume_size': 1, 'snapshot_id': '7031894e-a68c-4d2e-9dc8-63fb08477613'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132a18f3-1bec-4f34-bc87-28505cd831b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:10 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Volume volume-51c47bf0-98a0-4682-8504-4612bb688890 (51c47bf0-98a0-4682-8504-4612bb688890): created successfully Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132a18f3-1bec-4f34-bc87-28505cd831b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Flow 'volume_create_manager' (7647a650-7fb4-4f37-8c86-e70042cb39bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-70b50618-88a2-41a0-b55e-2adb4f50efd2 tempest-VolumesSnapshotTestJSON-1514898417 None] Created volume successfully. Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-51c47bf0-98a0-4682-8504-4612bb688890-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-51c47bf0-98a0-4682-8504-4612bb688890-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:11 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d 1073741824" returned: 0 in 0.650s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-51c47bf0-98a0-4682-8504-4612bb688890" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-51c47bf0-98a0-4682-8504-4612bb688890" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead3b81d-d56e-4780-bdcb-0c42bc75c430]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:11 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d Sep 29 12:06:11 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:11 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 Sep 29 12:06:11 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:12 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d" returned: 0 in 0.383s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f86f28-083a-486a-b1ff-312b40bdb988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:12 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50ddd9d-bf70-49da-adf5-a07ff6bde031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890" returned: 0 in 0.471s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:12 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890 Sep 29 12:06:12 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:12 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Volume volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d (b9fedd7d-7efe-4df1-ac15-198875d96c8d): created successfully Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50ddd9d-bf70-49da-adf5-a07ff6bde031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Flow 'volume_create_manager' (e9a9b720-2a20-4357-98f3-ae8a8480cd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:12 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:12 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:12 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-89766cae-063a-4368-861f-1dc21032450a tempest-VolumesListTestJSON-943665386 None] Created volume successfully. Sep 29 12:06:12 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-51c47bf0-98a0-4682-8504-4612bb688890" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:12 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-51c47bf0-98a0-4682-8504-4612bb688890" released by "delete_volume" :: held 0.925s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.397s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['ce0d3555-7c2c-416e-af57-ae797fab1769', '143172c1-2952-4a18-bb1e-c334dd506fb8', '1a1117e2-ded4-4a7c-ac6f-17197de73db2', '249b0e9b-b84b-4c03-95e0-7d47cc7ae50e'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:12 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:12 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:13 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Deleted volume successfully. Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-95095bb0-4348-4da5-9938-24f349fac842 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-51c47bf0-98a0-4682-8504-4612bb688890-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Acquiring lock "cinder-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Lock "cinder-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Acquiring lock "cinder-quobyte-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Lock "cinder-quobyte-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf3b63-54a5-4553-9551-8ac0cdbcd812]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:13 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b Sep 29 12:06:13 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Flow 'volume_create_manager' (44d5224f-b897-425c-ae90-47977caadceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa0a5b6-76ad-4e27-8ed6-5c110050ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa0a5b6-76ad-4e27-8ed6-5c110050ad93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1115798103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c92956-32a6-45a4-a775-22cce721e34a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='207e85984889407b812bfa0f51ee095a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:14Z,use_quota=True,user_id='205016020e0e4ccca82ee257296d8840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5466022f-5d0d-4843-8cd5-453f41093d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:13 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5466022f-5d0d-4843-8cd5-453f41093d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5039df-817d-40d6-a435-d4812568fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5039df-817d-40d6-a435-d4812568fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c92956-32a6-45a4-a775-22cce721e34a', 'volume_name': 'volume-34c92956-32a6-45a4-a775-22cce721e34a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc9579-f75e-4184-a454-79b9efb7e884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc9579-f75e-4184-a454-79b9efb7e884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d04ff6-e4dc-480c-b879-dccad0bc9cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Volume 34c92956-32a6-45a4-a775-22cce721e34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c92956-32a6-45a4-a775-22cce721e34a', 'volume_size': 1} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1115798103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c92956-32a6-45a4-a775-22cce721e34a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='207e85984889407b812bfa0f51ee095a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:14Z,use_quota=True,user_id='205016020e0e4ccca82ee257296d8840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Creating volume 34c92956-32a6-45a4-a775-22cce721e34a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:06:13 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-7031894e-a68c-4d2e-9dc8-63fb08477613-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b" returned: 0 in 0.579s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:13 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a 1073741824 Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:13 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-7031894e-a68c-4d2e-9dc8-63fb08477613-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:13 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-fd2a60ef-55da-482e-91b6-17283dab6353" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:13 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-fd2a60ef-55da-482e-91b6-17283dab6353" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-7031894e-a68c-4d2e-9dc8-63fb08477613" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-7031894e-a68c-4d2e-9dc8-63fb08477613" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Deleting offline snapshot 7031894e-a68c-4d2e-9dc8-63fb08477613 of volume fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] snapshot_file for this snap is: volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e86866-7fbd-47f8-bc47-0696f89f32ff]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:14 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 Sep 29 12:06:14 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:14 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b" returned: 0 in 0.295s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Lock "cinder-quobyte-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b" released by "delete_volume" :: held 0.928s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Created reservations ['519f7463-6626-4e97-92a6-304c0dcabc6b', '679d4e6a-3edc-4833-80ab-6a4dd30edd79', '5776f122-48ad-4585-a81a-e95e258ac9db', '21223a84-9a06-48b3-b2d5-7f257d9d81c1'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:14 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:14 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:14 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:14 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a 1073741824" returned: 0 in 0.552s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613" returned: 0 in 0.420s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2a60ef-55da-482e-91b6-17283dab6353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e3384-e923-4561-81a0-b84ca53b229a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:14 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a Sep 29 12:06:14 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:14 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 Sep 29 12:06:14 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:14 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:14 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Deleted volume successfully. Sep 29 12:06:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-71416883-f296-4d5d-b764-c7119263616f tempest-VolumesNegativeTest-1242014623 None] Lock "cinder-7a524e69-5b84-493d-9bcb-d1c74b5e0e8b-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:15 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a" returned: 0 in 0.471s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d04ff6-e4dc-480c-b879-dccad0bc9cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c92956-32a6-45a4-a775-22cce721e34a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03af266-8809-4cb5-aa5b-852657e0bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:15 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Volume volume-34c92956-32a6-45a4-a775-22cce721e34a (34c92956-32a6-45a4-a775-22cce721e34a): created successfully Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03af266-8809-4cb5-aa5b-852657e0bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Flow 'volume_create_manager' (44d5224f-b897-425c-ae90-47977caadceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:15 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-afd0b046-e0af-412e-a3f1-9db8ab4c2a6b tempest-VolumesListTestJSON-943665386 None] Created volume successfully. Sep 29 12:06:15 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353" returned: 0 in 0.845s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:15 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 Sep 29 12:06:15 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:15 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613" returned: 0 in 0.479s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:15 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613 Sep 29 12:06:15 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:16 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353.7031894e-a68c-4d2e-9dc8-63fb08477613" returned: 0 in 0.392s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-7031894e-a68c-4d2e-9dc8-63fb08477613" released by "_delete_snapshot" :: held 2.294s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-fd2a60ef-55da-482e-91b6-17283dab6353" released by "delete_snapshot" :: held 2.321s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['c93585fe-74c5-4bce-a874-b9117d2b8505', '258385ea-0bfc-4bc7-aeae-9982a73e775d', '05c00a05-18d0-4b59-b055-4517e7b09581', '4da751ab-122d-4aaa-96d3-6efeee72f042'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Delete snapshot completed successfully. Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-729aace8-d4f3-405d-a88b-49cfeca2237a tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-7031894e-a68c-4d2e-9dc8-63fb08477613-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Flow 'volume_create_manager' (c177e87e-2f6a-42af-a805-41b717732e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4203de37-d04f-48fa-a02d-b04aad534b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4203de37-d04f-48fa-a02d-b04aad534b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-568004484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df23a1-1ea9-4a3e-ad5f-53728be51dc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='207e85984889407b812bfa0f51ee095a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:17Z,use_quota=True,user_id='205016020e0e4ccca82ee257296d8840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5b8abd-f925-4adf-8767-4dd9721cba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5b8abd-f925-4adf-8767-4dd9721cba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389eeb6b-db50-4b7e-a113-8e51b7cf97d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389eeb6b-db50-4b7e-a113-8e51b7cf97d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95df23a1-1ea9-4a3e-ad5f-53728be51dc5', 'volume_name': 'volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc275e4e-3a0a-4331-ba0d-b58ca89f589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc275e4e-3a0a-4331-ba0d-b58ca89f589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7bd98c-beb8-44a5-b06a-da7b33f05c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Volume 95df23a1-1ea9-4a3e-ad5f-53728be51dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5', 'volume_size': 1} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-568004484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df23a1-1ea9-4a3e-ad5f-53728be51dc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='207e85984889407b812bfa0f51ee095a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:17Z,use_quota=True,user_id='205016020e0e4ccca82ee257296d8840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Creating volume 95df23a1-1ea9-4a3e-ad5f-53728be51dc5 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:06:16 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:06:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:16 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 1073741824 Sep 29 12:06:16 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-fd2a60ef-55da-482e-91b6-17283dab6353-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-fd2a60ef-55da-482e-91b6-17283dab6353-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-fd2a60ef-55da-482e-91b6-17283dab6353" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-fd2a60ef-55da-482e-91b6-17283dab6353" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:17 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 1073741824" returned: 0 in 0.634s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f93d7-b3e6-453d-ae0e-c2ea6ab1e0f7]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:17 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 Sep 29 12:06:17 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:17 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 Sep 29 12:06:17 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:17 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5" returned: 0 in 0.391s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7bd98c-beb8-44a5-b06a-da7b33f05c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d21d1d7-067f-486a-bd26-4d5a0df4e1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Volume volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 (95df23a1-1ea9-4a3e-ad5f-53728be51dc5): created successfully Sep 29 12:06:17 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d21d1d7-067f-486a-bd26-4d5a0df4e1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Flow 'volume_create_manager' (c177e87e-2f6a-42af-a805-41b717732e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353" returned: 0 in 0.485s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d8607e98-74ed-4d36-a506-816cc10643f1 tempest-VolumesListTestJSON-943665386 None] Created volume successfully. Sep 29 12:06:17 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353 Sep 29 12:06:17 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:18 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fd2a60ef-55da-482e-91b6-17283dab6353" returned: 0 in 0.307s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-fd2a60ef-55da-482e-91b6-17283dab6353" released by "delete_volume" :: held 0.898s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['8861be79-4b61-4629-be35-8ed952b8a75f', '544f5e7a-f4c2-4c29-a167-e5d0e447126f', '0fe273b6-0062-4a75-a7a8-47c0d7b5c3a3', '44c90b3e-548b-4578-be71-5616a15e67bb'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:18 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:18 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-8ae03efd-a653-4498-9c5e-923bed537104-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-8ae03efd-a653-4498-9c5e-923bed537104-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "cinder-quobyte-8ae03efd-a653-4498-9c5e-923bed537104" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-8ae03efd-a653-4498-9c5e-923bed537104" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:18 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.404s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d4d6eb-44c8-4f4c-b06c-09d46d1e329e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Deleted volume successfully. Sep 29 12:06:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6eb2706a-39b6-4f63-8857-b526e3b6e0c3 tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-fd2a60ef-55da-482e-91b6-17283dab6353-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:19 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 Sep 29 12:06:19 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:19 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104" returned: 0 in 0.586s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:19 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104 Sep 29 12:06:19 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:19 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8ae03efd-a653-4498-9c5e-923bed537104" returned: 0 in 0.431s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-quobyte-8ae03efd-a653-4498-9c5e-923bed537104" released by "delete_volume" :: held 1.174s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:19 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Created reservations ['8ed0355e-795c-4373-b728-9c12cb1b33f1', 'b7119b83-d3e5-4afa-8f65-a3c77d16c3c7', '66428958-ff61-42f6-8c91-02966a2d4dcc', 'b6080490-1027-4d7e-abef-c00c29d195d2'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:20 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:20 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:20 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.365s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Deleted volume successfully. Sep 29 12:06:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-97c186a8-6ebd-457a-8040-5ca199d892ed tempest-VolumesSnapshotTestJSON-1514898417 None] Lock "cinder-8ae03efd-a653-4498-9c5e-923bed537104-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "cinder-95df23a1-1ea9-4a3e-ad5f-53728be51dc5-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-95df23a1-1ea9-4a3e-ad5f-53728be51dc5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "cinder-quobyte-95df23a1-1ea9-4a3e-ad5f-53728be51dc5" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-quobyte-95df23a1-1ea9-4a3e-ad5f-53728be51dc5" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:21 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5409344c-8a72-44e4-a74b-2b12af92800a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:22 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 Sep 29 12:06:22 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:22 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5" returned: 0 in 0.524s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:22 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5 Sep 29 12:06:22 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:22 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-95df23a1-1ea9-4a3e-ad5f-53728be51dc5" returned: 0 in 0.317s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-quobyte-95df23a1-1ea9-4a3e-ad5f-53728be51dc5" released by "delete_volume" :: held 0.894s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Created reservations ['5535f6a8-e83b-4e9d-a752-e319ce9be65c', '9e9e27b2-c4bc-445f-868e-3b7b8d72611a', '11a4c6d2-70a1-4656-8f4f-3b233510b4dc', 'fe8823a2-9838-41b5-b8a5-5528ba00a0f1'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:23 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:23 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "cinder-34c92956-32a6-45a4-a775-22cce721e34a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-34c92956-32a6-45a4-a775-22cce721e34a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "cinder-quobyte-34c92956-32a6-45a4-a775-22cce721e34a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-quobyte-34c92956-32a6-45a4-a775-22cce721e34a" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae7f50-35b3-4438-bb61-a12a35bb39b5]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:23 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.386s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:23 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Deleted volume successfully. Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cc0d2c55-47f9-4c72-973e-ee802ecd1099 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-95df23a1-1ea9-4a3e-ad5f-53728be51dc5-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:23 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a Sep 29 12:06:23 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:23 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a" returned: 0 in 0.458s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:23 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a Sep 29 12:06:23 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:24 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-34c92956-32a6-45a4-a775-22cce721e34a" returned: 0 in 0.400s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-quobyte-34c92956-32a6-45a4-a775-22cce721e34a" released by "delete_volume" :: held 0.941s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Created reservations ['9a92aa43-f977-4e02-9446-6118097e8803', '3b57caa6-a311-400d-bd42-cc9f9e30ede2', '466dadfa-7199-4b19-9f7a-c6a1195b0bfd', 'd4ca1e80-655b-4fb2-9f1e-2d65013846ec'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:24 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:24 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:24 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.300s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:24 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Deleted volume successfully. Sep 29 12:06:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-475a7d06-2946-4068-aa49-3baf353226d3 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-34c92956-32a6-45a4-a775-22cce721e34a-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "cinder-b9fedd7d-7efe-4df1-ac15-198875d96c8d-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-b9fedd7d-7efe-4df1-ac15-198875d96c8d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "cinder-quobyte-b9fedd7d-7efe-4df1-ac15-198875d96c8d" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-quobyte-b9fedd7d-7efe-4df1-ac15-198875d96c8d" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:25 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdaf812-00aa-4b47-bdc7-5a90c46c87ba]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:25 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d Sep 29 12:06:25 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:26 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d" returned: 0 in 0.450s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:26 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d Sep 29 12:06:26 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:26 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b9fedd7d-7efe-4df1-ac15-198875d96c8d" returned: 0 in 0.415s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-quobyte-b9fedd7d-7efe-4df1-ac15-198875d96c8d" released by "delete_volume" :: held 0.933s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Created reservations ['21e82499-b640-4184-955c-d6638f1be197', '90f1755c-bce4-420b-bdd9-7f9efc0a834a', '27e170cd-e51e-4201-a443-31c2f1581608', '068e62ae-1933-4028-9586-208978001e29'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:26 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:26 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:27 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.283s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:27 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:27 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Deleted volume successfully. Sep 29 12:06:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-85867476-0cab-4c1b-a396-a924d1897c32 tempest-VolumesListTestJSON-943665386 None] Lock "cinder-b9fedd7d-7efe-4df1-ac15-198875d96c8d-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Flow 'volume_create_manager' (f58ce032-a16c-4777-8a95-b64806356c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6a46a3-bd0f-4929-a84a-c584d930d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6a46a3-bd0f-4929-a84a-c584d930d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-367166457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3da71-b403-4717-8f12-dd90f407f9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ac1ab8af9641c8b3ae8edac5f1cae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:35Z,use_quota=True,user_id='840eafe71fe94375a2f97ac10258ded8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be047d92-c157-4774-a50d-776e087c950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be047d92-c157-4774-a50d-776e087c950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0412c-7d52-4b40-a106-374b151b2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0412c-7d52-4b40-a106-374b151b2132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c3da71-b403-4717-8f12-dd90f407f9b9', 'volume_name': 'volume-d1c3da71-b403-4717-8f12-dd90f407f9b9', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5558188-b3d2-4ea4-9ab9-028ce0dcaf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5558188-b3d2-4ea4-9ab9-028ce0dcaf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7271c0e5-e49e-422f-8c63-8ef779919860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Volume d1c3da71-b403-4717-8f12-dd90f407f9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c3da71-b403-4717-8f12-dd90f407f9b9', 'volume_size': 1} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-367166457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3da71-b403-4717-8f12-dd90f407f9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ac1ab8af9641c8b3ae8edac5f1cae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:35Z,use_quota=True,user_id='840eafe71fe94375a2f97ac10258ded8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Creating volume d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:06:35 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:35 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 1073741824 Sep 29 12:06:35 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Flow 'volume_create_manager' (f20ceca0-4bbc-4ce0-9964-dacba0d11028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfc9389-bd29-4710-9e68-a88cbace2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfc9389-bd29-4710-9e68-a88cbace2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1056191675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebffdaf-775c-4f39-8b75-cc37ebfcb23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61347f45745744efb15848a808bc81a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:36Z,use_quota=True,user_id='09a1e15fff66438d8232076cfec2f047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f88b69-6633-417e-8580-ccdd77897ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f88b69-6633-417e-8580-ccdd77897ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f434c630-c726-4099-b54d-320c4e0a1199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f434c630-c726-4099-b54d-320c4e0a1199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ebffdaf-775c-4f39-8b75-cc37ebfcb23f', 'volume_name': 'volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f', 'volume_size': 2}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ba0367-3db9-40f5-86ff-78904e58aa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ba0367-3db9-40f5-86ff-78904e58aa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca68a6a-fa44-465b-9734-e716dc9dd5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:35 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Volume 4ebffdaf-775c-4f39-8b75-cc37ebfcb23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f', 'volume_size': 2} Sep 29 12:06:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:36 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 1073741824" returned: 0 in 0.565s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:36 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 Sep 29 12:06:36 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:36 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9" returned: 0 in 0.308s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.634s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1056191675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebffdaf-775c-4f39-8b75-cc37ebfcb23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61347f45745744efb15848a808bc81a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:36Z,use_quota=True,user_id='09a1e15fff66438d8232076cfec2f047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Creating volume 4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:06:36 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f 2147483648 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7271c0e5-e49e-422f-8c63-8ef779919860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c3da71-b403-4717-8f12-dd90f407f9b9', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9d8b4-1616-4a72-baba-9456340f9579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:36 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f 2147483648 Sep 29 12:06:36 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:36 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Volume volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 (d1c3da71-b403-4717-8f12-dd90f407f9b9): created successfully Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9d8b4-1616-4a72-baba-9456340f9579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Flow 'volume_create_manager' (f58ce032-a16c-4777-8a95-b64806356c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:36 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9e8e67f3-12ba-4ef5-84aa-748878d44240 tempest-VolumesSnapshotListTestJSON-1528084270 None] Created volume successfully. Sep 29 12:06:37 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f 2147483648" returned: 0 in 0.650s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:37 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f Sep 29 12:06:37 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:37 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca68a6a-fa44-465b-9734-e716dc9dd5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f', 'volume_size': 2}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cc0c43-1691-4eda-818f-2a61945e82ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:37 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Volume volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f (4ebffdaf-775c-4f39-8b75-cc37ebfcb23f): created successfully Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cc0c43-1691-4eda-818f-2a61945e82ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Flow 'volume_create_manager' (f20ceca0-4bbc-4ce0-9964-dacba0d11028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:37 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-82fb35e9-e06c-455f-9140-38bc0bb06155 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Created volume successfully. Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Creating offline snapshot 052d8799-d0b6-411b-a935-fb6bf130e95a of volume d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ca13b-3c46-41bf-a626-d372dfa4bc50]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:37 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 Sep 29 12:06:37 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:38 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9" returned: 0 in 0.653s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:38 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a 1G Sep 29 12:06:38 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:38 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a 1G" returned: 0 in 0.550s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:38 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a Sep 29 12:06:38 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:39 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a" returned: 0 in 0.345s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:39 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a is being set with open permissions: ugo+rw Sep 29 12:06:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:39 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a Sep 29 12:06:39 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:39 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a" returned: 0 in 0.282s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:39 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.info Sep 29 12:06:39 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:39 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.info" returned: 0 in 0.370s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:39 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.info is being set with open permissions: ugo+rw Sep 29 12:06:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:39 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.info Sep 29 12:06:39 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:40 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.info" returned: 0 in 0.317s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.167s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Creating offline snapshot 50aa8388-e785-4570-bcfb-3be842d1f1ec of volume 4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:06:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f68b64ca-47ae-487e-8653-2c41cf798274 tempest-VolumesSnapshotListTestJSON-1528084270 None] Create snapshot completed successfully Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f1f9f-6e1e-48c7-9c10-881d7e1532a3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:40 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f Sep 29 12:06:40 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:40 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" returned: 0 in 0.552s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec 2G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:40 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec 2G Sep 29 12:06:40 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:41 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec 2G" returned: 0 in 0.625s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:41 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec Sep 29 12:06:41 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:41 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec" returned: 0 in 0.376s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:41 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec is being set with open permissions: ugo+rw Sep 29 12:06:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:41 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec Sep 29 12:06:41 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:42 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec" returned: 0 in 0.350s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:42 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.info Sep 29 12:06:42 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:42 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.info" returned: 0 in 0.397s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:42 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.info is being set with open permissions: ugo+rw Sep 29 12:06:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:42 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.info Sep 29 12:06:42 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:43 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.info" returned: 0 in 0.308s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.874s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Creating offline snapshot 3e1e85d1-60dc-4352-abe1-e005f68cccb1 of volume d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:06:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0c03d98b-add5-4089-bf84-20088a4a5d55 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Create snapshot completed successfully Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc6f812-b350-4bc9-8331-9293b469294b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:43 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a Sep 29 12:06:43 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "cinder-50aa8388-e785-4570-bcfb-3be842d1f1ec-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-50aa8388-e785-4570-bcfb-3be842d1f1ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "cinder-quobyte-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-quobyte-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "cinder-quobyte-50aa8388-e785-4570-bcfb-3be842d1f1ec" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-quobyte-50aa8388-e785-4570-bcfb-3be842d1f1ec" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Deleting offline snapshot 50aa8388-e785-4570-bcfb-3be842d1f1ec of volume 4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:06:43 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] snapshot_file for this snap is: volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a" returned: 0 in 0.546s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3da71-b403-4717-8f12-dd90f407f9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d623a4e-e5f4-4088-b979-59c1036fde74]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:43 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 1G Sep 29 12:06:43 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:43 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec Sep 29 12:06:43 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:44 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec" returned: 0 in 0.525s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f93fee-6de0-4bd1-9948-52afc6551dd3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:44 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 1G" returned: 0 in 0.699s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:44 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 Sep 29 12:06:44 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:44 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f Sep 29 12:06:44 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:44 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" returned: 0 in 0.567s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:44 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1" returned: 0 in 0.480s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:44 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 is being set with open permissions: ugo+rw Sep 29 12:06:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:44 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec Sep 29 12:06:44 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:44 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 Sep 29 12:06:44 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:45 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1" returned: 0 in 0.374s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:45 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec" returned: 0 in 0.465s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:45 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec Sep 29 12:06:45 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e85e8a2e-fe78-4158-9d3e-e7d92f3c7147 tempest-VolumesSnapshotListTestJSON-1528084270 None] Create snapshot completed successfully Sep 29 12:06:45 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f.50aa8388-e785-4570-bcfb-3be842d1f1ec" returned: 0 in 0.393s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-quobyte-50aa8388-e785-4570-bcfb-3be842d1f1ec" released by "_delete_snapshot" :: held 2.135s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-quobyte-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" released by "delete_snapshot" :: held 2.171s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Created reservations ['0511fb2d-de72-4e2f-9700-b3b09a4d7bf8', '9d21add2-ccad-4f77-a75d-1cce1bfd1cc8', 'ad85c240-b601-4289-9d6d-9bdf0ddced84', '19595396-0120-4f33-b416-1abe32130ede'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Delete snapshot completed successfully. Sep 29 12:06:45 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1c6cbfe5-765a-4af3-ad50-fc9551690132 tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-50aa8388-e785-4570-bcfb-3be842d1f1ec-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Creating offline snapshot 0092d4ca-0525-43f5-90d7-711600cc4c27 of volume d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:06:46 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2f18f-a0a2-4a34-8361-dee3d2fbbd41]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "cinder-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:47 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 Sep 29 12:06:47 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "cinder-quobyte-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-quobyte-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1055e0a1-5726-4f5c-ba30-52a70b7ff66a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:47 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f Sep 29 12:06:47 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:47 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1" returned: 0 in 0.623s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3da71-b403-4717-8f12-dd90f407f9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:47 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 1G Sep 29 12:06:47 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:47 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" returned: 0 in 0.505s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:47 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f Sep 29 12:06:47 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:48 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" returned: 0 in 0.390s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-quobyte-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f" released by "delete_volume" :: held 0.996s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Created reservations ['d7ebe401-bd77-464e-8ea8-61be3f18f334', '7c5661c4-2368-4d3e-be4c-3049bda537c7', '71670d28-2de4-4c18-a538-8f680a7fb380', '14149072-dfc8-4768-901c-97c03f3d4e07'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:48 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 1G" returned: 0 in 0.836s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:48 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 Sep 29 12:06:48 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:48 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:06:48 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:48 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.368s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:06:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Deleted volume successfully. Sep 29 12:06:48 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27" returned: 0 in 0.456s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:48 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 is being set with open permissions: ugo+rw Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6e0e8b91-4107-44db-8961-6608bb28ea7e tempest-VolumesSnapshotNegativeTestJSON-127579459 None] Lock "cinder-4ebffdaf-775c-4f39-8b75-cc37ebfcb23f-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:48 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 Sep 29 12:06:48 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:49 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27" returned: 0 in 0.297s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-49898a2c-9d74-4998-9525-4f2b8c9c6ffa tempest-VolumesSnapshotListTestJSON-1528084270 None] Create snapshot completed successfully Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-0092d4ca-0525-43f5-90d7-711600cc4c27-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-0092d4ca-0525-43f5-90d7-711600cc4c27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-quobyte-0092d4ca-0525-43f5-90d7-711600cc4c27" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-0092d4ca-0525-43f5-90d7-711600cc4c27" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Deleting offline snapshot 0092d4ca-0525-43f5-90d7-711600cc4c27 of volume d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] snapshot_file for this snap is: volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[af846e24-d46a-4292-8022-6d5f142e1553]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:51 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 Sep 29 12:06:51 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:51 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27" returned: 0 in 0.537s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3da71-b403-4717-8f12-dd90f407f9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:52 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd7250-7aff-430e-87c6-6e4d7e31d7d0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:52 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 Sep 29 12:06:52 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:52 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1" returned: 0 in 0.420s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3da71-b403-4717-8f12-dd90f407f9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:52 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 Sep 29 12:06:52 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:53 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27" returned: 0 in 0.572s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:53 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27 Sep 29 12:06:53 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:53 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.0092d4ca-0525-43f5-90d7-711600cc4c27" returned: 0 in 0.366s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-0092d4ca-0525-43f5-90d7-711600cc4c27" released by "_delete_snapshot" :: held 2.066s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" released by "delete_snapshot" :: held 2.100s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Flow 'volume_create_manager' (566364d6-56f0-4f7b-9705-ab94e073e2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25d68ba-aec0-4a94-910c-3574a7928f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25d68ba-aec0-4a94-910c-3574a7928f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-517507049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aadf663-02fc-404d-9117-b551d8d5ebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd338107b31a425eafab9a5c20fdd6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:53Z,use_quota=True,user_id='f566acc8a4fe4f3bbb87609bcc7c7ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc980e8-1cd6-4f6c-88bd-de90c1b39e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc980e8-1cd6-4f6c-88bd-de90c1b39e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693ee020-a6f5-4697-bf20-4ecba7c51285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Created reservations ['05774800-ecf2-401e-bf4c-299f01ce9b5c', '1a8a3324-72d9-420c-ba4f-f9e53d8673d1', 'a310c1e4-2d37-4a4c-a747-140fcab12a32', '020172c6-d3fe-4f6c-b397-efef016927b1'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Delete snapshot completed successfully. Sep 29 12:06:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-db921f85-9098-4908-ad3b-5c33bf3c41c2 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-0092d4ca-0525-43f5-90d7-711600cc4c27-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693ee020-a6f5-4697-bf20-4ecba7c51285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3aadf663-02fc-404d-9117-b551d8d5ebe5', 'volume_name': 'volume-3aadf663-02fc-404d-9117-b551d8d5ebe5', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b832ebf8-30dd-4869-b8c7-74b603cbd70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b832ebf8-30dd-4869-b8c7-74b603cbd70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b5fa87-41ca-4735-aa95-e34137e74033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:06:54 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Volume 3aadf663-02fc-404d-9117-b551d8d5ebe5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3aadf663-02fc-404d-9117-b551d8d5ebe5', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Trying to clone 3aadf663-02fc-404d-9117-b551d8d5ebe5 from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-3e1e85d1-60dc-4352-abe1-e005f68cccb1-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-3e1e85d1-60dc-4352-abe1-e005f68cccb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-quobyte-3e1e85d1-60dc-4352-abe1-e005f68cccb1" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-3e1e85d1-60dc-4352-abe1-e005f68cccb1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Deleting offline snapshot 3e1e85d1-60dc-4352-abe1-e005f68cccb1 of volume d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] snapshot_file for this snap is: volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd1b806-53a5-4a3f-9618-6afbe373cac4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:06:54 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Image download 20.69 MB at 20.69 MB/s Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3579d1-023e-4400-9f59-6021111f5304]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:55 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 Sep 29 12:06:55 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:55 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD Sep 29 12:06:55 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:55 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a is fetched for user f566acc8a4fe4f3bbb87609bcc7c7ba6. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:06:55 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1" returned: 0 in 0.630s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3da71-b403-4717-8f12-dd90f407f9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f3bac-061a-4f9f-b811-e2aa6ad5194f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[283f49e1-398f-4c73-abb3-d5a6ba5568d7]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:55 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a Sep 29 12:06:55 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:55 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD Sep 29 12:06:55 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:55 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-517507049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aadf663-02fc-404d-9117-b551d8d5ebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd338107b31a425eafab9a5c20fdd6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:06:53Z,use_quota=True,user_id='f566acc8a4fe4f3bbb87609bcc7c7ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Creating volume 3aadf663-02fc-404d-9117-b551d8d5ebe5 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:06:56 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:56 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 1073741824 Sep 29 12:06:56 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:56 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a" returned: 0 in 0.545s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3da71-b403-4717-8f12-dd90f407f9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:56 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 Sep 29 12:06:56 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:56 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 1073741824" returned: 0 in 0.688s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:56 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1" returned: 0 in 0.625s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:56 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1 Sep 29 12:06:56 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:56 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 Sep 29 12:06:56 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:57 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.3e1e85d1-60dc-4352-abe1-e005f68cccb1" returned: 0 in 0.350s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-3e1e85d1-60dc-4352-abe1-e005f68cccb1" released by "_delete_snapshot" :: held 2.326s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" released by "delete_snapshot" :: held 2.364s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:57 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5" returned: 0 in 0.352s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Attempting download of 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 3aadf663-02fc-404d-9117-b551d8d5ebe5. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Created reservations ['d1a1493b-9442-485f-a4d9-7c9f174a1b0f', 'f7aedc85-a896-4c73-ba75-61ca78d684fb', '9b027cec-c9ef-4c2b-ba5c-ecaa7ebd90fc', 'c9fcafe7-b852-4ff4-9098-9d937d62205b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8b7f4-2ba3-4bc0-9173-307bd4872358]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_orbpnnjw {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Delete snapshot completed successfully. Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-05f9df03-e509-4a55-823c-64d1a98afced tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-3e1e85d1-60dc-4352-abe1-e005f68cccb1-delete_snapshot" released by "delete_snapshot" :: held 2.647s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:06:57 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_orbpnnjw Sep 29 12:06:57 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:57 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_orbpnnjw" returned: 0 in 0.460s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_orbpnnjw {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:57 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_orbpnnjw Sep 29 12:06:57 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-052d8799-d0b6-411b-a935-fb6bf130e95a-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-052d8799-d0b6-411b-a935-fb6bf130e95a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-quobyte-052d8799-d0b6-411b-a935-fb6bf130e95a" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-052d8799-d0b6-411b-a935-fb6bf130e95a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Deleting offline snapshot 052d8799-d0b6-411b-a935-fb6bf130e95a of volume d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] snapshot_file for this snap is: volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8adee70-c05c-4df8-8f15-7cf8ce8b099c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:58 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_orbpnnjw" returned: 1 in 0.425s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_orbpnnjw' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d0a47-d20f-4f4d-b4ff-bb421c238ff4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:58 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a Sep 29 12:06:58 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:58 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD Sep 29 12:06:58 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:58 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a" returned: 0 in 0.558s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3da71-b403-4717-8f12-dd90f407f9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:06:58 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] 2eff10fc-36b0-4954-8584-fe8c9e38eb2a was qcow2, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[743caa61-7366-47d7-bfc9-9457411378b2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:06:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:58 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 Sep 29 12:06:58 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:58 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 Sep 29 12:06:58 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:59 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9" returned: 0 in 0.602s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:06:59 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a Sep 29 12:06:59 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:06:59 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 29 12:06:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a" returned: 0 in 0.640s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:06:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:00 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a Sep 29 12:07:00 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:00 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9.052d8799-d0b6-411b-a935-fb6bf130e95a" returned: 0 in 0.402s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-052d8799-d0b6-411b-a935-fb6bf130e95a" released by "_delete_snapshot" :: held 2.429s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:07:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" released by "delete_snapshot" :: held 2.466s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:07:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Created reservations ['cb57fa79-89c4-4e6b-8d1f-8fdb226da0b9', '8ab54dbd-0687-4c2e-851e-df446ad09a74', '9f36c94a-f4ae-42ec-9f79-d4c5ae3546fc', '76a2248e-5e02-46b3-a162-1c34a6bce017'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:07:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Delete snapshot completed successfully. Sep 29 12:07:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d1283441-21f3-435f-a076-c0aa6997b0a0 tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-052d8799-d0b6-411b-a935-fb6bf130e95a-delete_snapshot" released by "delete_snapshot" :: held 2.786s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-d1c3da71-b403-4717-8f12-dd90f407f9b9-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-d1c3da71-b403-4717-8f12-dd90f407f9b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[80116f36-4dd2-4dc8-95d0-a161dacdc98a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:01 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5" returned: 0 in 3.039s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2eff10fc-36b0-4954-8584-fe8c9e38eb2a_wjceplhldevstack@QuobyteHD, size 112.00 MB, duration 3.04 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:07:01 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Converted 112.00 MB image at 36.84 MB/s Sep 29 12:07:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:01 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 1G Sep 29 12:07:01 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:01 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 Sep 29 12:07:01 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:02 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9" returned: 0 in 0.529s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:02 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9 Sep 29 12:07:02 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:02 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 1G" returned: 0 in 0.568s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Downloaded image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a ((None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}])) to volume 3aadf663-02fc-404d-9117-b551d8d5ebe5 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Temporary image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a for user f566acc8a4fe4f3bbb87609bcc7c7ba6 is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Marking volume 3aadf663-02fc-404d-9117-b551d8d5ebe5 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Copying metadata from image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a to 3aadf663-02fc-404d-9117-b551d8d5ebe5. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Creating volume glance metadata for volume 3aadf663-02fc-404d-9117-b551d8d5ebe5 backed by image 2eff10fc-36b0-4954-8584-fe8c9e38eb2a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:07:02 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-d1c3da71-b403-4717-8f12-dd90f407f9b9" returned: 0 in 0.332s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-quobyte-d1c3da71-b403-4717-8f12-dd90f407f9b9" released by "delete_volume" :: held 1.011s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b5fa87-41ca-4735-aa95-e34137e74033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aadf663-02fc-404d-9117-b551d8d5ebe5', 'volume_size': 1, 'image_id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1e5e546e43f48d3ab847dadfdd16217', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2eff10fc-36b0-4954-8584-fe8c9e38eb2a', 'created_at': datetime.datetime(2026, 9, 29, 9, 48, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 9, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2eff10fc-36b0-4954-8584-fe8c9e38eb2a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04c82c8-9552-42e8-aa38-e987581fd4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Created reservations ['025f40ea-6c58-47fc-aea1-1a0fa449a51a', 'f7e81df7-ed20-41c7-a328-481d82ae07a5', 'cfa4cebe-20e1-4a0d-b508-95d98368dfbd', 'f495077e-c6be-4611-90f8-e28b44d9a0ee'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:07:02 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Volume volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 (3aadf663-02fc-404d-9117-b551d8d5ebe5): created successfully Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04c82c8-9552-42e8-aa38-e987581fd4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Flow 'volume_create_manager' (566364d6-56f0-4f7b-9705-ab94e073e2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a9955b93-097d-477a-bc8c-113367fdc98e tempest-TestShelveInstance-159258773 None] Created volume successfully. Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:02 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:07:02 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:03 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.320s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:03 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:07:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Deleted volume successfully. Sep 29 12:07:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d45c9bd3-3195-48ef-b83f-9acdf0f6d5cc tempest-VolumesSnapshotListTestJSON-1528084270 None] Lock "cinder-d1c3da71-b403-4717-8f12-dd90f407f9b9-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:07:06 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=96,cinder:UPDATE=124,cinder:DELETE=10,cinder:INSERT=39 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=131,cinder:SELECT=112,cinder:INSERT=39,cinder:DELETE=10 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Flow 'volume_create_manager' (507b6222-92dc-4734-bc5b-daf1e33da25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b939b6f-9f97-47c0-8580-4d22d6da7f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b939b6f-9f97-47c0-8580-4d22d6da7f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-335140447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80654e36-ba29-4b0e-9ae7-b5f4620b67ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb4d2c2204d4bbe8d4da0b39b5ceb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:07Z,use_quota=True,user_id='c847a547d0e1426c9e72cf7288ad630e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99c04af-4551-4510-86c4-74ee9df80213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99c04af-4551-4510-86c4-74ee9df80213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ee8b1a-ff07-453e-9fb7-5d432ef08ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ee8b1a-ff07-453e-9fb7-5d432ef08ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80654e36-ba29-4b0e-9ae7-b5f4620b67ef', 'volume_name': 'volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dc544a-d15a-4902-b61b-db62183f8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dc544a-d15a-4902-b61b-db62183f8184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca7f6bd-9940-4121-b5a1-64c88591d2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:07 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Volume 80654e36-ba29-4b0e-9ae7-b5f4620b67ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef', 'volume_size': 1} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-335140447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80654e36-ba29-4b0e-9ae7-b5f4620b67ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb4d2c2204d4bbe8d4da0b39b5ceb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:07Z,use_quota=True,user_id='c847a547d0e1426c9e72cf7288ad630e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Creating volume 80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:07:07 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:07 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef 1073741824 Sep 29 12:07:07 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:07 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef 1073741824" returned: 0 in 0.737s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:08 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef Sep 29 12:07:08 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:08 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" returned: 0 in 0.366s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:07:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca7f6bd-9940-4121-b5a1-64c88591d2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cde806-87cf-44ce-bcfe-437368c864a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Volume volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef (80654e36-ba29-4b0e-9ae7-b5f4620b67ef): created successfully Sep 29 12:07:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cde806-87cf-44ce-bcfe-437368c864a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Flow 'volume_create_manager' (507b6222-92dc-4734-bc5b-daf1e33da25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:08 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-598395b4-b6df-4197-aa58-8ae7771fb989 tempest-TestStampPattern-128014972 None] Created volume successfully. Sep 29 12:07:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-ea3f0ebf-fdf4-4778-8b64-bc7bc1f74c15 req-3d3d6cbc-fcf5-4e14-b040-2d00f9941b08 tempest-TestShelveInstance-159258773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-ea3f0ebf-fdf4-4778-8b64-bc7bc1f74c15 req-3d3d6cbc-fcf5-4e14-b040-2d00f9941b08 tempest-TestShelveInstance-159258773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-ea3f0ebf-fdf4-4778-8b64-bc7bc1f74c15 req-3d3d6cbc-fcf5-4e14-b040-2d00f9941b08 tempest-TestShelveInstance-159258773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-ea3f0ebf-fdf4-4778-8b64-bc7bc1f74c15 req-3d3d6cbc-fcf5-4e14-b040-2d00f9941b08 tempest-TestShelveInstance-159258773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-3aadf663-02fc-404d-9117-b551d8d5ebe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65fa285e-6b95-4bf7-ad1b-635465f4196b', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:07:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-ea3f0ebf-fdf4-4778-8b64-bc7bc1f74c15 req-3d3d6cbc-fcf5-4e14-b040-2d00f9941b08 tempest-TestShelveInstance-159258773 None] attachment_update completed successfully. Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:12 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:07:12 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:12 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.370s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:07:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:07:20 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:07:20 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Flow 'volume_create_manager' (4fbdb97b-9756-4eb8-9bc5-7e2c8f94040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c55ca2e-45fa-471b-a10f-e2fae7b35e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c55ca2e-45fa-471b-a10f-e2fae7b35e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-606320184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433c225b-b19a-403e-8160-77f0ca5433e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ec861bed6243f2a7e2fbe925edfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:54Z,use_quota=True,user_id='5d2cf8b936354ef7b6c51c00507f67bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a54589b4-e366-4462-a2cb-80b8bbc60a2d),volume_type_id=a54589b4-e366-4462-a2cb-80b8bbc60a2d)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df8d687-5e42-4599-9a88-86fcb4224454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df8d687-5e42-4599-9a88-86fcb4224454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1a7ebd-6919-4ade-89ea-6c24772fc557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1a7ebd-6919-4ade-89ea-6c24772fc557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433c225b-b19a-403e-8160-77f0ca5433e1', 'volume_name': 'volume-433c225b-b19a-403e-8160-77f0ca5433e1', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20435a9-2b02-46b1-b5c4-dc9f80ffdf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20435a9-2b02-46b1-b5c4-dc9f80ffdf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1bc222-6f9e-45e8-83c9-e4c29b5a759a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:54 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume 433c225b-b19a-403e-8160-77f0ca5433e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433c225b-b19a-403e-8160-77f0ca5433e1', 'volume_size': 1} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-606320184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433c225b-b19a-403e-8160-77f0ca5433e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ec861bed6243f2a7e2fbe925edfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:54Z,use_quota=True,user_id='5d2cf8b936354ef7b6c51c00507f67bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a54589b4-e366-4462-a2cb-80b8bbc60a2d),volume_type_id=a54589b4-e366-4462-a2cb-80b8bbc60a2d)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Creating volume 433c225b-b19a-403e-8160-77f0ca5433e1 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:07:54 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:07:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:54 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 1073741824 Sep 29 12:07:54 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Flow 'volume_create_manager' (4eda0b3c-e5a4-41d0-9a12-ef70bd59dba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c16262-9d73-4185-89b7-7946193ec361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c16262-9d73-4185-89b7-7946193ec361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1473747017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17346855-9cd5-4ace-95f3-950cf81db85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ec861bed6243f2a7e2fbe925edfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:55Z,use_quota=True,user_id='5d2cf8b936354ef7b6c51c00507f67bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73b35384-ba6a-450d-8e1e-c194a3061a25),volume_type_id=73b35384-ba6a-450d-8e1e-c194a3061a25)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90fa0ba-7358-4200-9dbf-37d009873932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90fa0ba-7358-4200-9dbf-37d009873932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4c9f73-ad97-4ef4-9c9f-ec0b11ecf486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4c9f73-ad97-4ef4-9c9f-ec0b11ecf486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17346855-9cd5-4ace-95f3-950cf81db85b', 'volume_name': 'volume-17346855-9cd5-4ace-95f3-950cf81db85b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d98406-dd38-4e16-a33e-6fca84d26e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d98406-dd38-4e16-a33e-6fca84d26e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeae627d-3a18-4d40-a3c7-5dcfb2471a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:55 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume 17346855-9cd5-4ace-95f3-950cf81db85b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17346855-9cd5-4ace-95f3-950cf81db85b', 'volume_size': 1} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:55 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 1073741824" returned: 0 in 1.066s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:55 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 Sep 29 12:07:55 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:56 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1" returned: 0 in 0.387s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1473747017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17346855-9cd5-4ace-95f3-950cf81db85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ec861bed6243f2a7e2fbe925edfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:55Z,use_quota=True,user_id='5d2cf8b936354ef7b6c51c00507f67bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73b35384-ba6a-450d-8e1e-c194a3061a25),volume_type_id=73b35384-ba6a-450d-8e1e-c194a3061a25)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Creating volume 17346855-9cd5-4ace-95f3-950cf81db85b {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:07:56 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1bc222-6f9e-45e8-83c9-e4c29b5a759a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433c225b-b19a-403e-8160-77f0ca5433e1', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:56 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b 1073741824 Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cc5621-c4f8-444e-ac12-68a3d62e2b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:56 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:56 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume volume-433c225b-b19a-403e-8160-77f0ca5433e1 (433c225b-b19a-403e-8160-77f0ca5433e1): created successfully Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cc5621-c4f8-444e-ac12-68a3d62e2b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Flow 'volume_create_manager' (4fbdb97b-9756-4eb8-9bc5-7e2c8f94040b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:56 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-07bda7a6-513b-4d36-80d8-cdc92368a3a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Created volume successfully. Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Flow 'volume_create_manager' (8c6864dd-6d1c-435b-8a53-4af807bbe3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32168f28-424f-4e25-9a3a-b1b9176f85a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32168f28-424f-4e25-9a3a-b1b9176f85a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-903002347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4300640b-49c8-4603-b941-15afc2c378c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ec861bed6243f2a7e2fbe925edfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:56Z,use_quota=True,user_id='5d2cf8b936354ef7b6c51c00507f67bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01a57eab-a772-4128-9860-cb6ca17ec549),volume_type_id=01a57eab-a772-4128-9860-cb6ca17ec549)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784f3f82-2cde-4cee-a486-2ae72850bee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784f3f82-2cde-4cee-a486-2ae72850bee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255d58c8-9544-4415-8977-9c4afaeb7ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:56 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255d58c8-9544-4415-8977-9c4afaeb7ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4300640b-49c8-4603-b941-15afc2c378c6', 'volume_name': 'volume-4300640b-49c8-4603-b941-15afc2c378c6', 'volume_size': 1, 'image_id': 'fac67430-3d2d-4338-841a-5f6ae21c2688', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fac67430-3d2d-4338-841a-5f6ae21c2688', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1407514491', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00ec861bed6243f2a7e2fbe925edfdbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fac67430-3d2d-4338-841a-5f6ae21c2688', 'created_at': datetime.datetime(2026, 9, 29, 10, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 7, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fac67430-3d2d-4338-841a-5f6ae21c2688/file', 'properties': {}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38cdc64-dcce-4ae0-ab99-030adcbaf946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38cdc64-dcce-4ae0-ab99-030adcbaf946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df58b0a2-f369-4cb1-bf71-9ff6b6171047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume 4300640b-49c8-4603-b941-15afc2c378c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4300640b-49c8-4603-b941-15afc2c378c6', 'volume_size': 1, 'image_id': 'fac67430-3d2d-4338-841a-5f6ae21c2688', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fac67430-3d2d-4338-841a-5f6ae21c2688', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1407514491', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00ec861bed6243f2a7e2fbe925edfdbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fac67430-3d2d-4338-841a-5f6ae21c2688', 'created_at': datetime.datetime(2026, 9, 29, 10, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 7, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fac67430-3d2d-4338-841a-5f6ae21c2688/file', 'properties': {}}, 'image_service': } Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Trying to clone 4300640b-49c8-4603-b941-15afc2c378c6 from image fac67430-3d2d-4338-841a-5f6ae21c2688 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fac67430-3d2d-4338-841a-5f6ae21c2688', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:07:57 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b 1073741824" returned: 0 in 0.779s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:07:57 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b Sep 29 12:07:57 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:07:57 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b" returned: 0 in 0.539s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeae627d-3a18-4d40-a3c7-5dcfb2471a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17346855-9cd5-4ace-95f3-950cf81db85b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b6d1b-59da-4ac1-87c5-acbf9f1da317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:07:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume volume-17346855-9cd5-4ace-95f3-950cf81db85b (17346855-9cd5-4ace-95f3-950cf81db85b): created successfully Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b6d1b-59da-4ac1-87c5-acbf9f1da317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:07:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Flow 'volume_create_manager' (4eda0b3c-e5a4-41d0-9a12-ef70bd59dba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:07:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-89acfaac-438a-4c7a-a343-a8e4ff580ac9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Created volume successfully. Sep 29 12:07:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-24fd92bb-e4bb-4388-97a9-df75258c7383 req-e0f1eeeb-d454-48d8-8b72-90e1dd333645 tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:07:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-24fd92bb-e4bb-4388-97a9-df75258c7383 req-e0f1eeeb-d454-48d8-8b72-90e1dd333645 tempest-TestStampPattern-128014972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:07:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-24fd92bb-e4bb-4388-97a9-df75258c7383 req-e0f1eeeb-d454-48d8-8b72-90e1dd333645 tempest-TestStampPattern-128014972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:07:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-24fd92bb-e4bb-4388-97a9-df75258c7383 req-e0f1eeeb-d454-48d8-8b72-90e1dd333645 tempest-TestStampPattern-128014972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cfcaa2f-0a64-4ed5-98e5-09005ecd479e', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:07:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-24fd92bb-e4bb-4388-97a9-df75258c7383 req-e0f1eeeb-d454-48d8-8b72-90e1dd333645 tempest-TestStampPattern-128014972 None] attachment_update completed successfully. Sep 29 12:08:02 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD, size 20.69 MB, duration 5.12 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:08:02 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Image download 20.69 MB at 4.04 MB/s Sep 29 12:08:02 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5cceca-04c5-4d3e-b2f4-2336b11bf3de]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:02 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD Sep 29 12:08:02 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:02 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:02 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Temporary image fac67430-3d2d-4338-841a-5f6ae21c2688 is fetched for user 5d2cf8b936354ef7b6c51c00507f67bb. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:08:02 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba30c4d-80e6-4bae-96de-f0919a3298d8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:03 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD Sep 29 12:08:03 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:03 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-903002347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4300640b-49c8-4603-b941-15afc2c378c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ec861bed6243f2a7e2fbe925edfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:07:56Z,use_quota=True,user_id='5d2cf8b936354ef7b6c51c00507f67bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01a57eab-a772-4128-9860-cb6ca17ec549),volume_type_id=01a57eab-a772-4128-9860-cb6ca17ec549)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Creating volume 4300640b-49c8-4603-b941-15afc2c378c6 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:08:03 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:03 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 1073741824 Sep 29 12:08:03 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:03 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 1073741824" returned: 0 in 0.479s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:03 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 Sep 29 12:08:03 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:04 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6" returned: 0 in 0.319s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Attempting download of fac67430-3d2d-4338-841a-5f6ae21c2688 ((None, [{'url': 'file:///opt/stack/data/glance/images/fac67430-3d2d-4338-841a-5f6ae21c2688', 'metadata': {}}])) to volume 4300640b-49c8-4603-b941-15afc2c378c6. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3215ac-43dd-490c-885a-c0b8ac1f0cca]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fac67430-3d2d-4338-841a-5f6ae21c2688_n905gk7t {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:04 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fac67430-3d2d-4338-841a-5f6ae21c2688_n905gk7t Sep 29 12:08:04 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:04 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fac67430-3d2d-4338-841a-5f6ae21c2688_n905gk7t" returned: 0 in 0.385s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac67430-3d2d-4338-841a-5f6ae21c2688_n905gk7t {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:04 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac67430-3d2d-4338-841a-5f6ae21c2688_n905gk7t Sep 29 12:08:04 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:05 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac67430-3d2d-4338-841a-5f6ae21c2688_n905gk7t" returned: 1 in 0.421s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac67430-3d2d-4338-841a-5f6ae21c2688_n905gk7t' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[96404d59-c55a-49ac-a2b9-b349fd562bdc]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:05 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD Sep 29 12:08:05 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:05 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] fac67430-3d2d-4338-841a-5f6ae21c2688 was qcow2, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:05 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 Sep 29 12:08:05 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:05 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-9af210c1-938a-4ea7-9ade-08132d392eae req-b054b984-0ae4-47ae-86d3-43e66f34dce9 tempest-TestStampPattern-128014972 None] Terminate volume connection completed successfully. Sep 29 12:08:05 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-9af210c1-938a-4ea7-9ade-08132d392eae req-b054b984-0ae4-47ae-86d3-43e66f34dce9 tempest-TestStampPattern-128014972 None] Deleting attachment 6cfcaa2f-0a64-4ed5-98e5-09005ecd479e. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:08:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Creating offline snapshot 050c49b2-f728-4ee5-bf38-cfe6e49b6b93 of volume 80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:08:07 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[582cbf47-80ae-48b9-b319-1835dad05019]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:07 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef Sep 29 12:08:07 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:07 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" returned: 0 in 0.603s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:07 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 1G Sep 29 12:08:07 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:08 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6" returned: 0 in 2.839s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fac67430-3d2d-4338-841a-5f6ae21c2688_cnip0pw6devstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:08:08 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Converted 112.00 MB image at 39.43 MB/s Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:08 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 1G" returned: 0 in 0.844s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:08 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 1G Sep 29 12:08:08 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:08 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 Sep 29 12:08:08 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:08 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 1G" returned: 0 in 0.427s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Downloaded image fac67430-3d2d-4338-841a-5f6ae21c2688 ((None, [{'url': 'file:///opt/stack/data/glance/images/fac67430-3d2d-4338-841a-5f6ae21c2688', 'metadata': {}}])) to volume 4300640b-49c8-4603-b941-15afc2c378c6 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Temporary image fac67430-3d2d-4338-841a-5f6ae21c2688 for user 5d2cf8b936354ef7b6c51c00507f67bb is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Marking volume 4300640b-49c8-4603-b941-15afc2c378c6 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:08:08 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93" returned: 0 in 0.431s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:08 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 is being set with open permissions: ugo+rw Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Copying metadata from image fac67430-3d2d-4338-841a-5f6ae21c2688 to 4300640b-49c8-4603-b941-15afc2c378c6. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:08:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Creating volume glance metadata for volume 4300640b-49c8-4603-b941-15afc2c378c6 backed by image fac67430-3d2d-4338-841a-5f6ae21c2688 with: {'image_id': 'fac67430-3d2d-4338-841a-5f6ae21c2688', 'image_name': 'tempest-scenario-img--1407514491', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:08:08 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 Sep 29 12:08:08 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df58b0a2-f369-4cb1-bf71-9ff6b6171047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4300640b-49c8-4603-b941-15afc2c378c6', 'volume_size': 1, 'image_id': 'fac67430-3d2d-4338-841a-5f6ae21c2688', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fac67430-3d2d-4338-841a-5f6ae21c2688', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1407514491', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00ec861bed6243f2a7e2fbe925edfdbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fac67430-3d2d-4338-841a-5f6ae21c2688', 'created_at': datetime.datetime(2026, 9, 29, 10, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 7, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fac67430-3d2d-4338-841a-5f6ae21c2688/file', 'properties': {}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea486189-d3d9-454b-81b8-426ac5fe0106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:09 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Volume volume-4300640b-49c8-4603-b941-15afc2c378c6 (4300640b-49c8-4603-b941-15afc2c378c6): created successfully Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea486189-d3d9-454b-81b8-426ac5fe0106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Flow 'volume_create_manager' (8c6864dd-6d1c-435b-8a53-4af807bbe3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:08:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ab993f49-6a77-40ef-ae05-c0211f9059a2 tempest-TestInstancesWithCinderVolumes-1713224771 None] Created volume successfully. Sep 29 12:08:09 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93" returned: 0 in 0.319s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:09 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.info Sep 29 12:08:09 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:09 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.info" returned: 0 in 0.320s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:09 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.info is being set with open permissions: ugo+rw Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:09 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.info Sep 29 12:08:09 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:09 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.info" returned: 0 in 0.283s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-01824bdf-0b8f-47d8-969e-0bca018c1c17 tempest-TestStampPattern-128014972 None] Create snapshot completed successfully Sep 29 12:08:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-f6f18c18-5764-4407-92be-153584e6465e req-1c904c00-bfa4-4417-8ef4-86ba7327bb72 tempest-TestShelveInstance-159258773 None] Terminate volume connection completed successfully. Sep 29 12:08:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-f6f18c18-5764-4407-92be-153584e6465e req-1c904c00-bfa4-4417-8ef4-86ba7327bb72 tempest-TestShelveInstance-159258773 None] Deleting attachment 65fa285e-6b95-4bf7-ad1b-635465f4196b. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:12 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:08:12 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:12 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.329s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:08:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6489c297-8a6f-41ea-b25a-e7dc644052e2 req-82f69869-6eac-4660-9c03-d5fd0fc653ee tempest-TestShelveInstance-159258773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6489c297-8a6f-41ea-b25a-e7dc644052e2 req-82f69869-6eac-4660-9c03-d5fd0fc653ee tempest-TestShelveInstance-159258773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-6489c297-8a6f-41ea-b25a-e7dc644052e2 req-82f69869-6eac-4660-9c03-d5fd0fc653ee tempest-TestShelveInstance-159258773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-6489c297-8a6f-41ea-b25a-e7dc644052e2 req-82f69869-6eac-4660-9c03-d5fd0fc653ee tempest-TestShelveInstance-159258773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-3aadf663-02fc-404d-9117-b551d8d5ebe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af5e7de8-6289-4e9b-9658-1433ddb2d1a5', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:08:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-6489c297-8a6f-41ea-b25a-e7dc644052e2 req-82f69869-6eac-4660-9c03-d5fd0fc653ee tempest-TestShelveInstance-159258773 None] attachment_update completed successfully. Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-dd073837-04a0-4ff7-9ac3-d849d159c9ac req-4ad29c83-5982-4f5c-a344-aa999edf29da tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-dd073837-04a0-4ff7-9ac3-d849d159c9ac req-4ad29c83-5982-4f5c-a344-aa999edf29da tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-dd073837-04a0-4ff7-9ac3-d849d159c9ac req-4ad29c83-5982-4f5c-a344-aa999edf29da tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-dd073837-04a0-4ff7-9ac3-d849d159c9ac req-4ad29c83-5982-4f5c-a344-aa999edf29da tempest-TestInstancesWithCinderVolumes-1713224771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-4300640b-49c8-4603-b941-15afc2c378c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '542182ef-1bcd-4bc1-a39b-a61613cbee40', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:08:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-dd073837-04a0-4ff7-9ac3-d849d159c9ac req-4ad29c83-5982-4f5c-a344-aa999edf29da tempest-TestInstancesWithCinderVolumes-1713224771 None] attachment_update completed successfully. Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Flow 'volume_create_manager' (6a8df6f5-ed9a-4f76-9087-ede128b4b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25827606-d230-4f72-9ca9-820d521219c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25827606-d230-4f72-9ca9-820d521219c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1655946674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ebec4db-37f2-4a90-ad74-4ca1f7de46db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a66fc04678e4b56bf1d4721024cab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:08:21Z,use_quota=True,user_id='9882692582d44933aea2f6484e7bbe41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c3b82a-5eab-4f0b-9116-f1564076a1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c3b82a-5eab-4f0b-9116-f1564076a1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b959382-72a8-4229-9abf-e122f78d4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b959382-72a8-4229-9abf-e122f78d4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ebec4db-37f2-4a90-ad74-4ca1f7de46db', 'volume_name': 'volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352fa1a5-3827-40e1-8911-fccd9443c536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352fa1a5-3827-40e1-8911-fccd9443c536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b080cd6-2fa4-4f7c-b4ff-11bd2bf9b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Volume 0ebec4db-37f2-4a90-ad74-4ca1f7de46db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db', 'volume_size': 1} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1655946674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ebec4db-37f2-4a90-ad74-4ca1f7de46db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a66fc04678e4b56bf1d4721024cab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:08:21Z,use_quota=True,user_id='9882692582d44933aea2f6484e7bbe41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Creating volume 0ebec4db-37f2-4a90-ad74-4ca1f7de46db {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:08:20 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:08:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:21 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db 1073741824 Sep 29 12:08:21 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Flow 'volume_create_manager' (a7564c7f-7629-40c4-a799-0a8ff9c5ca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688085df-7244-4ef5-ab5c-bd8b9c35f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688085df-7244-4ef5-ab5c-bd8b9c35f55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-717956434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1a2840-2f50-4b1d-a596-f6724f90613b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb4d2c2204d4bbe8d4da0b39b5ceb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=050c49b2-f728-4ee5-bf38-cfe6e49b6b93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:08:21Z,use_quota=True,user_id='c847a547d0e1426c9e72cf7288ad630e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c628523-65a1-4695-bc2d-0929300ebdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c628523-65a1-4695-bc2d-0929300ebdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1495dbf3-c3d9-4f19-b1a3-5c2aa44ffed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1495dbf3-c3d9-4f19-b1a3-5c2aa44ffed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc1a2840-2f50-4b1d-a596-f6724f90613b', 'volume_name': 'volume-bc1a2840-2f50-4b1d-a596-f6724f90613b', 'volume_size': 1, 'snapshot_id': '050c49b2-f728-4ee5-bf38-cfe6e49b6b93'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5191802e-01bb-4acf-a832-2f700286df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5191802e-01bb-4acf-a832-2f700286df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51c3d29-9708-42fb-a4d4-1eb8e2c94421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:21 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Volume bc1a2840-2f50-4b1d-a596-f6724f90613b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc1a2840-2f50-4b1d-a596-f6724f90613b', 'volume_size': 1, 'snapshot_id': '050c49b2-f728-4ee5-bf38-cfe6e49b6b93'} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:21 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db 1073741824" returned: 0 in 0.797s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:21 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db Sep 29 12:08:21 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:22 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db" returned: 0 in 0.457s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.761s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-quobyte-050c49b2-f728-4ee5-bf38-cfe6e49b6b93-bc1a2840-2f50-4b1d-a596-f6724f90613b" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b080cd6-2fa4-4f7c-b4ff-11bd2bf9b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584cdd33-7e3c-48e8-8383-4bd2214201b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-050c49b2-f728-4ee5-bf38-cfe6e49b6b93-bc1a2840-2f50-4b1d-a596-f6724f90613b" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Creating volume bc1a2840-2f50-4b1d-a596-f6724f90613b from snapshot 050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-quobyte-bc1a2840-2f50-4b1d-a596-f6724f90613b" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:08:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Volume volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db (0ebec4db-37f2-4a90-ad74-4ca1f7de46db): created successfully Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584cdd33-7e3c-48e8-8383-4bd2214201b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Flow 'volume_create_manager' (6a8df6f5-ed9a-4f76-9087-ede128b4b17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-bc1a2840-2f50-4b1d-a596-f6724f90613b" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] snapshot: 050c49b2-f728-4ee5-bf38-cfe6e49b6b93, volume: bc1a2840-2f50-4b1d-a596-f6724f90613b, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:08:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b1ace717-0b84-4b60-ad01-098bdc4d0cea tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Created volume successfully. Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[066fceca-0489-4936-b543-cdca61ef7c02]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:22 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 Sep 29 12:08:22 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:23 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93" returned: 0 in 1.059s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:08:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc342a58-11ad-424a-8092-095ef830badf]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:23 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef Sep 29 12:08:23 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:24 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" returned: 0 in 0.855s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:08:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:08:24 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:08:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:24 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b Sep 29 12:08:24 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-785b8026-75e1-4d96-a8f2-bb186689092f req-4ee124aa-5724-4b35-a9b6-810e9965f692 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:35 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=4,cinder:SELECT=37 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:08:36 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=46,cinder:UPDATE=16,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b" returned: 0 in 16.773s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef, size 1024.00 MB, duration 16.77 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:08:41 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Converted 1024.00 MB image at 61.04 MB/s Sep 29 12:08:41 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b is being set with open permissions: ugo+rw Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:41 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b Sep 29 12:08:41 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:41 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b" returned: 0 in 0.613s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-bc1a2840-2f50-4b1d-a596-f6724f90613b" released by "_copy_volume_from_snapshot" :: held 19.541s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-050c49b2-f728-4ee5-bf38-cfe6e49b6b93-bc1a2840-2f50-4b1d-a596-f6724f90613b" released by "_create_volume_from_snapshot" :: held 19.670s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 19.713s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-785b8026-75e1-4d96-a8f2-bb186689092f req-4ee124aa-5724-4b35-a9b6-810e9965f692 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.909s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-785b8026-75e1-4d96-a8f2-bb186689092f req-4ee124aa-5724-4b35-a9b6-810e9965f692 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51c3d29-9708-42fb-a4d4-1eb8e2c94421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1a2840-2f50-4b1d-a596-f6724f90613b', 'volume_size': 1, 'snapshot_id': '050c49b2-f728-4ee5-bf38-cfe6e49b6b93'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7e43a2-cf1a-4f0a-bd89-ef1139773e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:08:42 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Volume volume-bc1a2840-2f50-4b1d-a596-f6724f90613b (bc1a2840-2f50-4b1d-a596-f6724f90613b): created successfully Sep 29 12:08:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7e43a2-cf1a-4f0a-bd89-ef1139773e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:08:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Flow 'volume_create_manager' (a7564c7f-7629-40c4-a799-0a8ff9c5ca92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:08:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-785b8026-75e1-4d96-a8f2-bb186689092f req-4ee124aa-5724-4b35-a9b6-810e9965f692 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5496c9b8-32ec-4fe4-ae73-3ac3784c6f7c', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:08:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a749264c-b7a3-4b22-a4df-fb0c80e6bf7e tempest-TestStampPattern-128014972 None] Created volume successfully. Sep 29 12:08:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-785b8026-75e1-4d96-a8f2-bb186689092f req-4ee124aa-5724-4b35-a9b6-810e9965f692 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] attachment_update completed successfully. Sep 29 12:08:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-9aa5baa8-fdd4-41a1-9495-f36b08a0d104 req-d4ba6aa1-7831-4822-972e-33cfc1f8f524 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Terminate volume connection completed successfully. Sep 29 12:08:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-9aa5baa8-fdd4-41a1-9495-f36b08a0d104 req-d4ba6aa1-7831-4822-972e-33cfc1f8f524 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Deleting attachment 5496c9b8-32ec-4fe4-ae73-3ac3784c6f7c. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:08:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Acquiring lock "cinder-0ebec4db-37f2-4a90-ad74-4ca1f7de46db-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:08:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "cinder-0ebec4db-37f2-4a90-ad74-4ca1f7de46db-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:08:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Acquiring lock "cinder-quobyte-0ebec4db-37f2-4a90-ad74-4ca1f7de46db" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:08:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "cinder-quobyte-0ebec4db-37f2-4a90-ad74-4ca1f7de46db" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:08:50 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48c35ac-2494-4d17-a33e-7bf6edc1c1d3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:08:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:50 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db Sep 29 12:08:50 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:51 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db" returned: 0 in 0.465s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:51 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db Sep 29 12:08:51 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:51 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-0ebec4db-37f2-4a90-ad74-4ca1f7de46db" returned: 0 in 0.271s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "cinder-quobyte-0ebec4db-37f2-4a90-ad74-4ca1f7de46db" released by "delete_volume" :: held 0.802s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Created reservations ['62272df4-ad40-4dc3-bcf7-285a9061bf0f', '606d18d1-4501-4cf3-ba90-e9a427198c7c', '81c63652-f4ec-4179-b294-0707d8a7b017', 'dd6b5ff7-490b-4e47-b6f4-6c910b0e3bdc'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:08:51 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:08:51 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:08:51 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.364s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:08:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Deleted volume successfully. Sep 29 12:08:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3d161d86-89c9-415b-b26b-ce63bbf71499 tempest-TestServerVolumeAttachScenarioOldVersion-1652023015 None] Lock "cinder-0ebec4db-37f2-4a90-ad74-4ca1f7de46db-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:08:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-79b0dfd9-ab29-4c97-9dcd-29fef96326b8 req-6e9848a6-ab08-4a84-83d4-d045e94cbeeb tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:08:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-79b0dfd9-ab29-4c97-9dcd-29fef96326b8 req-6e9848a6-ab08-4a84-83d4-d045e94cbeeb tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:08:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-79b0dfd9-ab29-4c97-9dcd-29fef96326b8 req-6e9848a6-ab08-4a84-83d4-d045e94cbeeb tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:08:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-79b0dfd9-ab29-4c97-9dcd-29fef96326b8 req-6e9848a6-ab08-4a84-83d4-d045e94cbeeb tempest-TestInstancesWithCinderVolumes-1713224771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-433c225b-b19a-403e-8160-77f0ca5433e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec5c15ff-afe8-4947-b51a-1175a9cbec0f', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:08:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-79b0dfd9-ab29-4c97-9dcd-29fef96326b8 req-6e9848a6-ab08-4a84-83d4-d045e94cbeeb tempest-TestInstancesWithCinderVolumes-1713224771 None] attachment_update completed successfully. Sep 29 12:09:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-55f524e7-eb5f-486e-bb4e-5f01c2e3d835 req-c9c49414-93db-41c4-a40a-877eede47252 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-55f524e7-eb5f-486e-bb4e-5f01c2e3d835 req-c9c49414-93db-41c4-a40a-877eede47252 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-55f524e7-eb5f-486e-bb4e-5f01c2e3d835 req-c9c49414-93db-41c4-a40a-877eede47252 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-55f524e7-eb5f-486e-bb4e-5f01c2e3d835 req-c9c49414-93db-41c4-a40a-877eede47252 tempest-TestInstancesWithCinderVolumes-1713224771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-17346855-9cd5-4ace-95f3-950cf81db85b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82ff177d-b1e6-47f9-95a0-11b54d99e7cb', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:09:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-55f524e7-eb5f-486e-bb4e-5f01c2e3d835 req-c9c49414-93db-41c4-a40a-877eede47252 tempest-TestInstancesWithCinderVolumes-1713224771 None] attachment_update completed successfully. Sep 29 12:09:05 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-97e4d6b9-1044-46bf-a1c3-ca654111f867 tempest-TestShelveInstance-159258773 None] Terminate volume connection completed successfully. Sep 29 12:09:05 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-97e4d6b9-1044-46bf-a1c3-ca654111f867 tempest-TestShelveInstance-159258773 None] Deleting attachment af5e7de8-6289-4e9b-9658-1433ddb2d1a5. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:09:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Acquiring lock "cinder-3aadf663-02fc-404d-9117-b551d8d5ebe5-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Lock "cinder-3aadf663-02fc-404d-9117-b551d8d5ebe5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Acquiring lock "cinder-quobyte-3aadf663-02fc-404d-9117-b551d8d5ebe5" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Lock "cinder-quobyte-3aadf663-02fc-404d-9117-b551d8d5ebe5" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:05 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5934cef6-ae4a-449c-ae90-54b8678a8da3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:05 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 Sep 29 12:09:05 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:06 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5" returned: 0 in 0.599s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:06 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5 Sep 29 12:09:06 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:06 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3aadf663-02fc-404d-9117-b551d8d5ebe5" returned: 0 in 0.363s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Lock "cinder-quobyte-3aadf663-02fc-404d-9117-b551d8d5ebe5" released by "delete_volume" :: held 1.060s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG cinder.quota [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Created reservations ['06aa0799-bf38-45bb-b770-d5825dea7cd2', 'febcb222-080c-4cde-8901-908d28c54a6e', '190d22e7-fab3-4db6-bfd7-0cfb052149e6', 'fd653849-08b8-4178-994e-3d0d382ee8c7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:06 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:06 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:07 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.349s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:07 devstack cinder-volume[86117]: DEBUG cinder.manager [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Deleted volume successfully. Sep 29 12:09:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [req-e44e854c-bc7b-43a9-af42-98c5a5970f98 req-3cf01597-fc4e-4e56-8469-fc14981157a8 tempest-TestShelveInstance-159258773 None] Lock "cinder-3aadf663-02fc-404d-9117-b551d8d5ebe5-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-44dc1d94-3bf7-41cb-8c47-bb36be284715 req-858a73db-62d0-4905-affb-537d1fd18581 tempest-TestInstancesWithCinderVolumes-1713224771 None] Terminate volume connection completed successfully. Sep 29 12:09:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-44dc1d94-3bf7-41cb-8c47-bb36be284715 req-858a73db-62d0-4905-affb-537d1fd18581 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deleting attachment ec5c15ff-afe8-4947-b51a-1175a9cbec0f. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:09:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "cinder-433c225b-b19a-403e-8160-77f0ca5433e1-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-433c225b-b19a-403e-8160-77f0ca5433e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "cinder-quobyte-433c225b-b19a-403e-8160-77f0ca5433e1" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-quobyte-433c225b-b19a-403e-8160-77f0ca5433e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:10 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d79117-6069-4aa4-9242-72881ef5fd70]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:10 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 Sep 29 12:09:10 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:11 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1" returned: 0 in 0.481s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:11 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1 Sep 29 12:09:11 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:11 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-433c225b-b19a-403e-8160-77f0ca5433e1" returned: 0 in 0.428s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-quobyte-433c225b-b19a-403e-8160-77f0ca5433e1" released by "delete_volume" :: held 0.962s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:11 devstack cinder-volume[86117]: WARNING cinder.quota [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1417689880-1712375676 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1417689880-1712375676, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:11 devstack cinder-volume[86117]: WARNING cinder.quota [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1417689880-1712375676 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1417689880-1712375676, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Created reservations ['ff471ee6-cf74-4062-a5a7-290452ac8440', '465cadb9-10ac-4b54-93db-2a8fa255900f', 'fce0156f-1289-4934-a0a8-5503a4bd5913', '5227e123-ac00-4576-8420-f3db0a861762'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:12 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:12 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:12 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:12 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:12 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.390s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:12 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deleted volume successfully. Sep 29 12:09:12 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.387s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:09:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b87967d6-91d0-4ff5-a3df-8408a087d610 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-433c225b-b19a-403e-8160-77f0ca5433e1-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:15 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-fad01264-b8cd-49d1-88e1-4af54da971d6 req-2feb32e4-bbfa-444a-985b-72d20f1d68e9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Terminate volume connection completed successfully. Sep 29 12:09:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-fad01264-b8cd-49d1-88e1-4af54da971d6 req-2feb32e4-bbfa-444a-985b-72d20f1d68e9 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deleting attachment 82ff177d-b1e6-47f9-95a0-11b54d99e7cb. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:09:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "cinder-17346855-9cd5-4ace-95f3-950cf81db85b-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-17346855-9cd5-4ace-95f3-950cf81db85b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "cinder-quobyte-17346855-9cd5-4ace-95f3-950cf81db85b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-quobyte-17346855-9cd5-4ace-95f3-950cf81db85b" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:16 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9447f86-7a8c-495a-b9fe-d829a5d65696]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:16 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b Sep 29 12:09:16 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:17 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b" returned: 0 in 0.565s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:17 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b Sep 29 12:09:17 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:17 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-17346855-9cd5-4ace-95f3-950cf81db85b" returned: 0 in 0.413s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-quobyte-17346855-9cd5-4ace-95f3-950cf81db85b" released by "delete_volume" :: held 1.057s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:17 devstack cinder-volume[86117]: WARNING cinder.quota [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-513853790-1844978012 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-513853790-1844978012, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:17 devstack cinder-volume[86117]: WARNING cinder.quota [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-513853790-1844978012 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-513853790-1844978012, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Created reservations ['a5512b4e-9543-40e3-9e36-9f703364ec73', 'c557563d-ba35-45e6-9b3d-e897d8272264', '762e7754-4d18-4ea2-95f3-2f88b757b5e8', '00a4691f-f4d0-4233-a338-4c578d7249ee'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:17 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:17 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:18 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.387s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deleted volume successfully. Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2b59d3c8-3e83-4eb4-a933-d5b76dc87c45 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-17346855-9cd5-4ace-95f3-950cf81db85b-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Flow 'volume_create_manager' (5331c21d-0997-4a1d-8612-3f78a8fce133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b3913f-1043-4ffb-b397-c571927a5a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b3913f-1043-4ffb-b397-c571927a5a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90170a8f-03db-4d1a-afd2-d39a0332a2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9cac9e71e04f5398568e3528d754b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:09:19Z,use_quota=True,user_id='84b4fd1ec8e54b9780997cd56edb7a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ecab9f2-1909-4130-8e72-70fa639b43d3),volume_type_id=4ecab9f2-1909-4130-8e72-70fa639b43d3)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978027b4-847e-4b6c-9910-49d9d34e46b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978027b4-847e-4b6c-9910-49d9d34e46b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7cd2df-dbf1-4278-9cd9-2fa397773ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:18 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7cd2df-dbf1-4278-9cd9-2fa397773ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90170a8f-03db-4d1a-afd2-d39a0332a2d3', 'volume_name': 'volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3', 'volume_size': 1, 'image_id': '474a37b1-0c4c-437f-8fac-33466181e3b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/474a37b1-0c4c-437f-8fac-33466181e3b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bc4e7b2efde3b8681c63cb280da605', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d9cac9e71e04f5398568e3528d754b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6904d952bc0f1eae610315e506f5cafbfeb5cd42a0085a295f6ca8614e8d53e4a7ec89af3cc1a2cef39f510eedb57990346050430afb01f43b64d9363e33290', 'id': '474a37b1-0c4c-437f-8fac-33466181e3b8', 'created_at': datetime.datetime(2026, 9, 29, 10, 9, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 9, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/474a37b1-0c4c-437f-8fac-33466181e3b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025307d5-bcbb-49f0-a2b0-1aaa2800381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025307d5-bcbb-49f0-a2b0-1aaa2800381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8254a4-7e32-4949-b5d5-4588db31a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Volume 90170a8f-03db-4d1a-afd2-d39a0332a2d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3', 'volume_size': 1, 'image_id': '474a37b1-0c4c-437f-8fac-33466181e3b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/474a37b1-0c4c-437f-8fac-33466181e3b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bc4e7b2efde3b8681c63cb280da605', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d9cac9e71e04f5398568e3528d754b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6904d952bc0f1eae610315e506f5cafbfeb5cd42a0085a295f6ca8614e8d53e4a7ec89af3cc1a2cef39f510eedb57990346050430afb01f43b64d9363e33290', 'id': '474a37b1-0c4c-437f-8fac-33466181e3b8', 'created_at': datetime.datetime(2026, 9, 29, 10, 9, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 9, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/474a37b1-0c4c-437f-8fac-33466181e3b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Trying to clone 90170a8f-03db-4d1a-afd2-d39a0332a2d3 from image 474a37b1-0c4c-437f-8fac-33466181e3b8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/474a37b1-0c4c-437f-8fac-33466181e3b8', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:09:19 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28cac86-7b40-4927-a586-26e0c748119f]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:19 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD Sep 29 12:09:19 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:20 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:20 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD Sep 29 12:09:20 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:20 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:09:20 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Temporary image 474a37b1-0c4c-437f-8fac-33466181e3b8 is fetched for user 84b4fd1ec8e54b9780997cd56edb7a0a. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:09:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6a7ffa-23a0-40aa-8db5-ae8c6aeb6a07]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:21 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD Sep 29 12:09:21 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:21 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:21 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD Sep 29 12:09:21 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:21 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD" returned: 1 in 0.585s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90170a8f-03db-4d1a-afd2-d39a0332a2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9cac9e71e04f5398568e3528d754b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:09:19Z,use_quota=True,user_id='84b4fd1ec8e54b9780997cd56edb7a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ecab9f2-1909-4130-8e72-70fa639b43d3),volume_type_id=4ecab9f2-1909-4130-8e72-70fa639b43d3)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Creating volume 90170a8f-03db-4d1a-afd2-d39a0332a2d3 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:09:21 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:09:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:21 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 1073741824 Sep 29 12:09:21 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-2c617b08-d8a0-49ae-8183-1c478c9a2a99 req-651b1a82-6930-4d1c-999f-cfc637e2b47b tempest-TestInstancesWithCinderVolumes-1713224771 None] Terminate volume connection completed successfully. Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-2c617b08-d8a0-49ae-8183-1c478c9a2a99 req-651b1a82-6930-4d1c-999f-cfc637e2b47b tempest-TestInstancesWithCinderVolumes-1713224771 None] Deleting attachment 542182ef-1bcd-4bc1-a39b-a61613cbee40. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:09:22 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 1073741824" returned: 0 in 0.613s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:22 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 Sep 29 12:09:22 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:22 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3" returned: 0 in 0.277s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Attempting download of 474a37b1-0c4c-437f-8fac-33466181e3b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/474a37b1-0c4c-437f-8fac-33466181e3b8', 'metadata': {}}])) to volume 90170a8f-03db-4d1a-afd2-d39a0332a2d3. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b7614f-6f5f-4144-89e5-39884357fc0f]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_474a37b1-0c4c-437f-8fac-33466181e3b8_7rz_x64u {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:23 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_474a37b1-0c4c-437f-8fac-33466181e3b8_7rz_x64u Sep 29 12:09:23 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "cinder-4300640b-49c8-4603-b941-15afc2c378c6-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-4300640b-49c8-4603-b941-15afc2c378c6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "cinder-quobyte-4300640b-49c8-4603-b941-15afc2c378c6" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-quobyte-4300640b-49c8-4603-b941-15afc2c378c6" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[986b7492-a686-49b0-afd3-b9c58408e8a0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:23 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_474a37b1-0c4c-437f-8fac-33466181e3b8_7rz_x64u" returned: 0 in 0.393s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_474a37b1-0c4c-437f-8fac-33466181e3b8_7rz_x64u {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:23 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 Sep 29 12:09:23 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:23 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_474a37b1-0c4c-437f-8fac-33466181e3b8_7rz_x64u Sep 29 12:09:23 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:23 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6" returned: 0 in 0.402s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:23 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6 Sep 29 12:09:23 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:23 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_474a37b1-0c4c-437f-8fac-33466181e3b8_7rz_x64u" returned: 1 in 0.383s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_474a37b1-0c4c-437f-8fac-33466181e3b8_7rz_x64u' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac29b907-1ce6-4af6-8b83-eab2e466daf3]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:23 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD Sep 29 12:09:23 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:23 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4300640b-49c8-4603-b941-15afc2c378c6" returned: 0 in 0.270s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-quobyte-4300640b-49c8-4603-b941-15afc2c378c6" released by "delete_volume" :: held 0.738s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:24 devstack cinder-volume[86117]: WARNING cinder.quota [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-874674783-296110140 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-874674783-296110140, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:24 devstack cinder-volume[86117]: WARNING cinder.quota [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-874674783-296110140 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-874674783-296110140, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Created reservations ['00cd21bd-86b2-4ee1-adb6-e4f9befa8de9', '873b333a-7edc-4eb5-a707-22f93167a4f6', 'e8c216d5-c752-47e7-8cf6-7ed150886fa8', 'd7335fa9-27b2-43c5-9bba-14610973b26c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:24 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:24 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:24 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:24 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD Sep 29 12:09:24 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:24 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.352s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:24 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Deleted volume successfully. Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c400701a-5c03-4daf-9b45-62d48b91e115 tempest-TestInstancesWithCinderVolumes-1713224771 None] Lock "cinder-4300640b-49c8-4603-b941-15afc2c378c6-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:24 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] 474a37b1-0c4c-437f-8fac-33466181e3b8 was raw, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:09:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:24 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 Sep 29 12:09:24 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:25 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3" returned: 0 in 0.692s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_474a37b1-0c4c-437f-8fac-33466181e3b8_xib1qkpldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:09:25 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:25 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 1G Sep 29 12:09:25 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:25 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 1G" returned: 0 in 0.401s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Downloaded image 474a37b1-0c4c-437f-8fac-33466181e3b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/474a37b1-0c4c-437f-8fac-33466181e3b8', 'metadata': {}}])) to volume 90170a8f-03db-4d1a-afd2-d39a0332a2d3 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Temporary image 474a37b1-0c4c-437f-8fac-33466181e3b8 for user 84b4fd1ec8e54b9780997cd56edb7a0a is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Marking volume 90170a8f-03db-4d1a-afd2-d39a0332a2d3 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Copying metadata from image 474a37b1-0c4c-437f-8fac-33466181e3b8 to 90170a8f-03db-4d1a-afd2-d39a0332a2d3. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Creating volume glance metadata for volume 90170a8f-03db-4d1a-afd2-d39a0332a2d3 backed by image 474a37b1-0c4c-437f-8fac-33466181e3b8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '474a37b1-0c4c-437f-8fac-33466181e3b8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '27bc4e7b2efde3b8681c63cb280da605', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8254a4-7e32-4949-b5d5-4588db31a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3', 'volume_size': 1, 'image_id': '474a37b1-0c4c-437f-8fac-33466181e3b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/474a37b1-0c4c-437f-8fac-33466181e3b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bc4e7b2efde3b8681c63cb280da605', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d9cac9e71e04f5398568e3528d754b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6904d952bc0f1eae610315e506f5cafbfeb5cd42a0085a295f6ca8614e8d53e4a7ec89af3cc1a2cef39f510eedb57990346050430afb01f43b64d9363e33290', 'id': '474a37b1-0c4c-437f-8fac-33466181e3b8', 'created_at': datetime.datetime(2026, 9, 29, 10, 9, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 9, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/474a37b1-0c4c-437f-8fac-33466181e3b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d506ef7-226c-4cdc-b6c8-f95ccf067c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:25 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Volume volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 (90170a8f-03db-4d1a-afd2-d39a0332a2d3): created successfully Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d506ef7-226c-4cdc-b6c8-f95ccf067c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Flow 'volume_create_manager' (5331c21d-0997-4a1d-8612-3f78a8fce133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:09:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4d5023b1-5f1d-47d0-ae33-b5e08923f92a tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Created volume successfully. Sep 29 12:09:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Acquiring lock "cinder-90170a8f-03db-4d1a-afd2-d39a0332a2d3-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "cinder-90170a8f-03db-4d1a-afd2-d39a0332a2d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Acquiring lock "cinder-quobyte-90170a8f-03db-4d1a-afd2-d39a0332a2d3" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:26 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "cinder-quobyte-90170a8f-03db-4d1a-afd2-d39a0332a2d3" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:26 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc57665-d877-4637-a40b-8e40da84038e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:26 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 Sep 29 12:09:26 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:27 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3" returned: 0 in 0.408s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:27 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3 Sep 29 12:09:27 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:27 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-90170a8f-03db-4d1a-afd2-d39a0332a2d3" returned: 0 in 0.334s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "cinder-quobyte-90170a8f-03db-4d1a-afd2-d39a0332a2d3" released by "delete_volume" :: held 0.813s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:27 devstack cinder-volume[86117]: WARNING cinder.quota [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:27 devstack cinder-volume[86117]: WARNING cinder.quota [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Created reservations ['10008f04-6321-4177-8eb8-0840dff5e13b', '570a8260-28fc-4820-9889-376e7009f8e4', '08f70051-475f-429b-9527-0311bfa75369', '20cb65ad-f405-42f6-a111-8b56ecc5eeb9'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:27 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:27 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:28 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.364s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:28 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Deleted volume successfully. Sep 29 12:09:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a419b1cb-dded-4bb3-a925-90fab4e4bb5b tempest-VolumeAndVolumeTypeFromImageTest-820521464 None] Lock "cinder-90170a8f-03db-4d1a-afd2-d39a0332a2d3-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-04756890-b785-462b-85de-a09f042e1bd0 req-bbbe3234-0cc4-42ac-80b1-4dbe8751f72d tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-04756890-b785-462b-85de-a09f042e1bd0 req-bbbe3234-0cc4-42ac-80b1-4dbe8751f72d tempest-TestStampPattern-128014972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-04756890-b785-462b-85de-a09f042e1bd0 req-bbbe3234-0cc4-42ac-80b1-4dbe8751f72d tempest-TestStampPattern-128014972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:28 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-04756890-b785-462b-85de-a09f042e1bd0 req-bbbe3234-0cc4-42ac-80b1-4dbe8751f72d tempest-TestStampPattern-128014972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-bc1a2840-2f50-4b1d-a596-f6724f90613b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f4b2510-a1a4-46b2-9114-58fe4e007c7f', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:09:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-04756890-b785-462b-85de-a09f042e1bd0 req-bbbe3234-0cc4-42ac-80b1-4dbe8751f72d tempest-TestStampPattern-128014972 None] attachment_update completed successfully. Sep 29 12:09:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-ff187ee8-dc67-409a-ada4-de3c7356daf4 req-eefbcfbc-066d-4c9a-be78-5db48ab3c116 tempest-TestStampPattern-128014972 None] Terminate volume connection completed successfully. Sep 29 12:09:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-ff187ee8-dc67-409a-ada4-de3c7356daf4 req-eefbcfbc-066d-4c9a-be78-5db48ab3c116 tempest-TestStampPattern-128014972 None] Deleting attachment 1f4b2510-a1a4-46b2-9114-58fe4e007c7f. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-bc1a2840-2f50-4b1d-a596-f6724f90613b-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Lock "cinder-bc1a2840-2f50-4b1d-a596-f6724f90613b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=65,cinder:SELECT=66,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=77,cinder:UPDATE=59,cinder:DELETE=4,cinder:INSERT=20 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-quobyte-bc1a2840-2f50-4b1d-a596-f6724f90613b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-bc1a2840-2f50-4b1d-a596-f6724f90613b" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95aa4be-2a0a-423d-9e99-e350f6321b25]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:42 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b Sep 29 12:09:42 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:42 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b" returned: 0 in 0.462s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:42 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b Sep 29 12:09:42 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:43 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bc1a2840-2f50-4b1d-a596-f6724f90613b" returned: 0 in 0.313s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-bc1a2840-2f50-4b1d-a596-f6724f90613b" released by "delete_volume" :: held 0.828s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Created reservations ['19f3b727-038e-444e-b70e-982e55327b80', 'a0ba1884-e29a-4e19-8b65-f4d29fcb62c7', '71a3128f-d50e-43f5-9287-dceb3a2dd282', '64f9377f-71b1-40a5-88d3-a11bb288ff2f'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:43 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:43 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:43 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.309s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Deleted volume successfully. Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a2bbb5f8-e0ff-4757-a8c6-457ba06d5713 tempest-TestStampPattern-128014972 None] Lock "cinder-bc1a2840-2f50-4b1d-a596-f6724f90613b-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-050c49b2-f728-4ee5-bf38-cfe6e49b6b93-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Lock "cinder-050c49b2-f728-4ee5-bf38-cfe6e49b6b93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-quobyte-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-quobyte-050c49b2-f728-4ee5-bf38-cfe6e49b6b93" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-050c49b2-f728-4ee5-bf38-cfe6e49b6b93" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Deleting offline snapshot 050c49b2-f728-4ee5-bf38-cfe6e49b6b93 of volume 80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:09:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] snapshot_file for this snap is: volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:09:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99aff5-d4b4-42f6-96be-3ceb4417d5b9]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:44 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 Sep 29 12:09:44 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:44 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93" returned: 0 in 0.465s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:09:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1901ee17-e216-4f35-9d96-263b35e36458]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:44 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef Sep 29 12:09:44 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:45 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" returned: 0 in 0.669s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:45 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 Sep 29 12:09:45 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:45 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93" returned: 0 in 0.475s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:45 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93 Sep 29 12:09:45 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:46 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef.050c49b2-f728-4ee5-bf38-cfe6e49b6b93" returned: 0 in 0.334s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-050c49b2-f728-4ee5-bf38-cfe6e49b6b93" released by "_delete_snapshot" :: held 2.105s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" released by "delete_snapshot" :: held 2.132s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:46 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Created reservations ['78465220-68b8-4ace-b87c-751ead52968f', '9c53c017-fa0b-44cd-8824-a1fd95d1c432', '5ccd3f4d-bbae-4924-bb9d-2a95fa8ef18f', '94a80d5a-e557-4382-b400-895d13a48f5c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:46 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Delete snapshot completed successfully. Sep 29 12:09:46 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e125898-486d-49cd-bbd9-5b25db15cf69 tempest-TestStampPattern-128014972 None] Lock "cinder-050c49b2-f728-4ee5-bf38-cfe6e49b6b93-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Flow 'volume_create_manager' (3315e051-57ec-4d8c-b33f-471d7a17cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0c07ca-bbf9-43c6-94bc-88bf98a41cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0c07ca-bbf9-43c6-94bc-88bf98a41cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1203642411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9511c64b-2818-4184-a080-c6f616629761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c44ef887624fcba1e66916c423fa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:09:49Z,use_quota=True,user_id='0dc18fbbc06346a3bb86bbda65a0e4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff9a36c-b064-4117-a03e-7d0a1443c458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff9a36c-b064-4117-a03e-7d0a1443c458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bea7cbc-6228-4287-8645-af1a9b9470a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bea7cbc-6228-4287-8645-af1a9b9470a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9511c64b-2818-4184-a080-c6f616629761', 'volume_name': 'volume-9511c64b-2818-4184-a080-c6f616629761', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30686b3-b21d-423f-aa15-9bede094dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30686b3-b21d-423f-aa15-9bede094dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e253279-5f0d-495d-8323-a6e952153a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Volume 9511c64b-2818-4184-a080-c6f616629761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9511c64b-2818-4184-a080-c6f616629761', 'volume_size': 1} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1203642411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9511c64b-2818-4184-a080-c6f616629761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c44ef887624fcba1e66916c423fa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:09:49Z,use_quota=True,user_id='0dc18fbbc06346a3bb86bbda65a0e4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Creating volume 9511c64b-2818-4184-a080-c6f616629761 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:09:49 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:09:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:49 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 1073741824 Sep 29 12:09:49 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:50 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 1073741824" returned: 0 in 0.727s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:50 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 Sep 29 12:09:50 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:50 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761" returned: 0 in 0.297s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e253279-5f0d-495d-8323-a6e952153a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9511c64b-2818-4184-a080-c6f616629761', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa24e4c-0268-43ba-adfe-9a08695fcf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:09:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Volume volume-9511c64b-2818-4184-a080-c6f616629761 (9511c64b-2818-4184-a080-c6f616629761): created successfully Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa24e4c-0268-43ba-adfe-9a08695fcf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:09:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Flow 'volume_create_manager' (3315e051-57ec-4d8c-b33f-471d7a17cf57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:09:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-caac5a1b-afca-4972-81b4-1a06528aa9de tempest-TestImageHashVerification-942483481 None] Created volume successfully. Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc49c4-6b38-4054-ac17-b994524f84d0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-80654e36-ba29-4b0e-9ae7-b5f4620b67ef-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:52 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 Sep 29 12:09:52 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Lock "cinder-80654e36-ba29-4b0e-9ae7-b5f4620b67ef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Acquiring lock "cinder-quobyte-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" acquired by "delete_volume" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd733a3-95d9-4ac1-acf9-a29a239d337f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:52 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef Sep 29 12:09:52 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:52 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761" returned: 0 in 0.463s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ba3493-4683-4300-b8a1-cacd4f31e837]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:09:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:52 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 Sep 29 12:09:52 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:53 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" returned: 0 in 0.438s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:53 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef Sep 29 12:09:53 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:53 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761" returned: 0 in 0.429s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 /opt/stack/data/cinder/conversion/9511c64b-2818-4184-a080-c6f616629761.temp_image.e2518a05-240f-47d8-9a80-654f17f31e860q2ao2zi.img {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:53 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 /opt/stack/data/cinder/conversion/9511c64b-2818-4184-a080-c6f616629761.temp_image.e2518a05-240f-47d8-9a80-654f17f31e860q2ao2zi.img Sep 29 12:09:53 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:53 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" returned: 0 in 0.309s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Lock "cinder-quobyte-80654e36-ba29-4b0e-9ae7-b5f4620b67ef" released by "delete_volume" :: held 0.859s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Created reservations ['1868d51a-cb6d-4e26-9355-7259506d4182', '1012033b-09da-4917-9634-7650cc802964', 'af45dbea-7b4c-4670-a64a-cdfb285e2e8f', '5d835895-1787-4838-9e8d-d55d85957604'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:09:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:09:53 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:09:53 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:09:54 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 29 12:09:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.690s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:09:54 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:09:54 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Deleted volume successfully. Sep 29 12:09:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8883f59e-f6ce-40cb-85d3-3ed13d74febe tempest-TestStampPattern-128014972 None] Lock "cinder-80654e36-ba29-4b0e-9ae7-b5f4620b67ef-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:02 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 /opt/stack/data/cinder/conversion/9511c64b-2818-4184-a080-c6f616629761.temp_image.e2518a05-240f-47d8-9a80-654f17f31e860q2ao2zi.img" returned: 0 in 8.756s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:02 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[587bd16d-2d78-4302-8460-c21039d06f3b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:02 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 Sep 29 12:10:02 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:02 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761" returned: 0 in 0.655s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:02 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/conversion/9511c64b-2818-4184-a080-c6f616629761.temp_image.e2518a05-240f-47d8-9a80-654f17f31e860q2ao2zi.img {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:10:02 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Converted 1024.00 MB image at 116.93 MB/s Sep 29 12:10:02 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] e2518a05-240f-47d8-9a80-654f17f31e86 was raw, no need to convert to raw {{(pid=86117) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 12:10:03 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:12 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:12 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:12 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.422s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:10:12 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Flow 'volume_create_manager' (8556fb19-660b-41df-abc2-03e8d3b9fd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c9b04a-2121-451e-adaa-a82eb912de83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c9b04a-2121-451e-adaa-a82eb912de83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1928336928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55713b50-5777-4740-b672-d8dee8a8c65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634cd6e6e121475abd85ece549a2216d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:16Z,use_quota=True,user_id='7367ee056a9c47d6818cceece1b21643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e093f1ea-409a-4015-bbc9-b3765d22b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e093f1ea-409a-4015-bbc9-b3765d22b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87be8f9e-a0b6-4dce-96a0-0df03b903869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87be8f9e-a0b6-4dce-96a0-0df03b903869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55713b50-5777-4740-b672-d8dee8a8c65d', 'volume_name': 'volume-55713b50-5777-4740-b672-d8dee8a8c65d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604b7289-9ba7-41a4-9840-3868c8a3b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604b7289-9ba7-41a4-9840-3868c8a3b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3861c5-71cd-4c28-a0d8-7a67ba4779e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Volume 55713b50-5777-4740-b672-d8dee8a8c65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55713b50-5777-4740-b672-d8dee8a8c65d', 'volume_size': 1} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Flow 'volume_create_manager' (728046fa-39d6-438f-9ef4-c6d5c76be6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50401882-1e93-4d79-bf41-42136871649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50401882-1e93-4d79-bf41-42136871649e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-600161354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182535f1-35f9-40b0-845e-cb28cf23bac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634cd6e6e121475abd85ece549a2216d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:17Z,use_quota=True,user_id='7367ee056a9c47d6818cceece1b21643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8fb1c9-c878-4eea-b605-658e7f9a125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8fb1c9-c878-4eea-b605-658e7f9a125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818ebd9c-9155-4951-9b7b-d726915bc9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818ebd9c-9155-4951-9b7b-d726915bc9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182535f1-35f9-40b0-845e-cb28cf23bac8', 'volume_name': 'volume-182535f1-35f9-40b0-845e-cb28cf23bac8', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f3e6e5-9827-4908-9e5e-a0cf10dc5bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f3e6e5-9827-4908-9e5e-a0cf10dc5bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fbdb05-4e3c-4785-8eb2-09a0a51dd176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Volume 182535f1-35f9-40b0-845e-cb28cf23bac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182535f1-35f9-40b0-845e-cb28cf23bac8', 'volume_size': 1} Sep 29 12:10:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (b7386a63-0c17-4b71-9d16-c9fb27d9db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa7cbb4-9441-4b5c-bdce-c513011fb1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa7cbb4-9441-4b5c-bdce-c513011fb1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1334981493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1021a1-65bf-4000-9c21-186a3ab2ccac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:20Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835e7c2c-e0fe-457a-8b12-ac7567fbb910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835e7c2c-e0fe-457a-8b12-ac7567fbb910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1073ef79-28e1-4c5b-821b-f9672ceead7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1073ef79-28e1-4c5b-821b-f9672ceead7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1021a1-65bf-4000-9c21-186a3ab2ccac', 'volume_name': 'volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f9d2d3-155a-4ff7-8731-2ba14f70e76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f9d2d3-155a-4ff7-8731-2ba14f70e76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39da2018-9a58-46c8-902c-279444c0e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Volume 9d1021a1-65bf-4000-9c21-186a3ab2ccac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac', 'volume_size': 1} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (93319b97-b812-4738-bffb-93d9e7ba0dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c0cd25-02b0-4d8b-8806-13db4626601a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c0cd25-02b0-4d8b-8806-13db4626601a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020377810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48823d-028d-4497-986d-8592881a6bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:20Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0c0cb1-0f86-4663-b7e3-4ae686956ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0c0cb1-0f86-4663-b7e3-4ae686956ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f4ca4c-c621-4622-a3d7-3c6048628537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f4ca4c-c621-4622-a3d7-3c6048628537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f48823d-028d-4497-986d-8592881a6bd3', 'volume_name': 'volume-4f48823d-028d-4497-986d-8592881a6bd3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6319b72d-f5d9-4319-92e8-673d10716e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6319b72d-f5d9-4319-92e8-673d10716e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dbdbfc-1207-4c99-bdd3-403b399b8703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Volume 4f48823d-028d-4497-986d-8592881a6bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f48823d-028d-4497-986d-8592881a6bd3', 'volume_size': 1} Sep 29 12:10:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (e07e2eff-0a46-469b-9674-8491f798f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acae64e1-d956-4b3d-a2e5-98933f48bf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acae64e1-d956-4b3d-a2e5-98933f48bf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161562210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b37e69-894e-4906-8c1e-6270fee86aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:21Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbac0222-78ac-46a9-8cda-ce43c25de2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbac0222-78ac-46a9-8cda-ce43c25de2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b07548-0d99-466c-b5c0-3ddc9956e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b07548-0d99-466c-b5c0-3ddc9956e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b37e69-894e-4906-8c1e-6270fee86aeb', 'volume_name': 'volume-80b37e69-894e-4906-8c1e-6270fee86aeb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4282cfd9-c3ee-42ec-ae85-4430b6f790e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4282cfd9-c3ee-42ec-ae85-4430b6f790e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c239e7-9a31-41bb-8733-9421b01eedba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Volume 80b37e69-894e-4906-8c1e-6270fee86aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b37e69-894e-4906-8c1e-6270fee86aeb', 'volume_size': 1} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (02c1c0b1-9351-4f5e-a88c-2c63458c5655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f87e4a-c27b-42db-9d22-268e19475628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f87e4a-c27b-42db-9d22-268e19475628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1209750262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f78265-f3ed-4bb1-8e55-f7d08cdfd14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:22Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c1fa75-0943-40dd-841d-b98dcdc913c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c1fa75-0943-40dd-841d-b98dcdc913c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5266103f-fcea-4116-bccf-594b7e283c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5266103f-fcea-4116-bccf-594b7e283c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f78265-f3ed-4bb1-8e55-f7d08cdfd14e', 'volume_name': 'volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35076e8-be98-4247-842e-94ad80b88786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35076e8-be98-4247-842e-94ad80b88786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0784712e-ce49-4dd4-bdeb-62b09f7948fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:21 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Volume 91f78265-f3ed-4bb1-8e55-f7d08cdfd14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e', 'volume_size': 1} Sep 29 12:10:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (f1fe8e35-88fc-4dc2-94fd-96baddfae785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52109b1-8fd5-4501-8f30-3bc1b694a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52109b1-8fd5-4501-8f30-3bc1b694a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723901348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3637b4a5-3323-43d3-908e-aaf55527843e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:22Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2738ed7-5a93-418a-b91e-e05e795d17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2738ed7-5a93-418a-b91e-e05e795d17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34be066-9c60-43ab-9eba-d0497b9d7a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34be066-9c60-43ab-9eba-d0497b9d7a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3637b4a5-3323-43d3-908e-aaf55527843e', 'volume_name': 'volume-3637b4a5-3323-43d3-908e-aaf55527843e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836bc4c7-ce4b-4e33-b0d3-9ff3fda3c2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836bc4c7-ce4b-4e33-b0d3-9ff3fda3c2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca5284f-41e5-40b0-bfa7-29cb31958e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Volume 3637b4a5-3323-43d3-908e-aaf55527843e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3637b4a5-3323-43d3-908e-aaf55527843e', 'volume_size': 1} Sep 29 12:10:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.332s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Uploaded volume to glance image-id: e2518a05-240f-47d8-9a80-654f17f31e86. {{(pid=86117) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.207s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1928336928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55713b50-5777-4740-b672-d8dee8a8c65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634cd6e6e121475abd85ece549a2216d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:16Z,use_quota=True,user_id='7367ee056a9c47d6818cceece1b21643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Creating volume 55713b50-5777-4740-b672-d8dee8a8c65d {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:28 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:28 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d 1073741824 Sep 29 12:10:28 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e2218963-8d9d-4c9b-8820-2429b08a615a tempest-TestImageHashVerification-942483481 None] Copy volume to image completed successfully. Sep 29 12:10:29 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d 1073741824" returned: 0 in 0.517s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:29 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d Sep 29 12:10:29 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:29 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.615s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-600161354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182535f1-35f9-40b0-845e-cb28cf23bac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634cd6e6e121475abd85ece549a2216d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:17Z,use_quota=True,user_id='7367ee056a9c47d6818cceece1b21643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Creating volume 182535f1-35f9-40b0-845e-cb28cf23bac8 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:29 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3861c5-71cd-4c28-a0d8-7a67ba4779e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55713b50-5777-4740-b672-d8dee8a8c65d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:29 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 1073741824 Sep 29 12:10:29 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d1814a-4848-4c42-88d9-f51311eca34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:29 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Volume volume-55713b50-5777-4740-b672-d8dee8a8c65d (55713b50-5777-4740-b672-d8dee8a8c65d): created successfully Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d1814a-4848-4c42-88d9-f51311eca34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Flow 'volume_create_manager' (8556fb19-660b-41df-abc2-03e8d3b9fd81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:29 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8d379a6c-4374-45d9-a04a-4ae1040ebed6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Created volume successfully. Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Acquiring lock "cinder-9511c64b-2818-4184-a080-c6f616629761-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Lock "cinder-9511c64b-2818-4184-a080-c6f616629761-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Acquiring lock "cinder-quobyte-9511c64b-2818-4184-a080-c6f616629761" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Lock "cinder-quobyte-9511c64b-2818-4184-a080-c6f616629761" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e164cc8-3b79-4ddb-a288-11e1c72d35c9]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:30 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 1073741824" returned: 0 in 0.629s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:30 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 Sep 29 12:10:30 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:30 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 Sep 29 12:10:30 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:30 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8" returned: 0 in 0.298s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.391s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1334981493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1021a1-65bf-4000-9c21-186a3ab2ccac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:20Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Creating volume 9d1021a1-65bf-4000-9c21-186a3ab2ccac {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:30 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:30 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac 1073741824 Sep 29 12:10:30 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fbdb05-4e3c-4785-8eb2-09a0a51dd176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182535f1-35f9-40b0-845e-cb28cf23bac8', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018e2285-838c-4f11-a97c-df54ddd3a41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Volume volume-182535f1-35f9-40b0-845e-cb28cf23bac8 (182535f1-35f9-40b0-845e-cb28cf23bac8): created successfully Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018e2285-838c-4f11-a97c-df54ddd3a41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Flow 'volume_create_manager' (728046fa-39d6-438f-9ef4-c6d5c76be6c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:30 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761" returned: 0 in 0.641s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:30 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fb608087-21a6-4fa9-bae6-da5634d94959 tempest-TestServerVolumeAttachmentScenario-250069272 None] Created volume successfully. Sep 29 12:10:30 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761 Sep 29 12:10:30 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:31 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9511c64b-2818-4184-a080-c6f616629761" returned: 0 in 0.405s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Lock "cinder-quobyte-9511c64b-2818-4184-a080-c6f616629761" released by "delete_volume" :: held 1.121s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Created reservations ['3385a72e-e2ae-4d10-9446-dfbf2eef3d5d', '57af0461-dd4e-445c-bab1-15d89cdff3a2', 'b3d16138-a9c1-478e-902d-adbdc11a0746', 'c5338ff2-9f8a-4dd6-8939-0639d04e606e'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:31 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac 1073741824" returned: 0 in 0.719s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:31 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:31 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:31 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:31 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:31 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.409s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Deleted volume successfully. Sep 29 12:10:31 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac" returned: 0 in 0.503s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.120s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020377810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48823d-028d-4497-986d-8592881a6bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:20Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Creating volume 4f48823d-028d-4497-986d-8592881a6bd3 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:31 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e4f3e70-4cfa-4095-8b94-b78cddd236a7 tempest-TestImageHashVerification-942483481 None] Lock "cinder-9511c64b-2818-4184-a080-c6f616629761-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39da2018-9a58-46c8-902c-279444c0e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:31 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 1073741824 Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5dd9f5-8ce6-4154-8aed-12fa467664a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:31 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Volume volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac (9d1021a1-65bf-4000-9c21-186a3ab2ccac): created successfully Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5dd9f5-8ce6-4154-8aed-12fa467664a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (b7386a63-0c17-4b71-9d16-c9fb27d9db0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9d23063c-2720-419f-9f64-48e1c0c4bee2 tempest-CreateVolumesFromImageTest-1837723747 None] Created volume successfully. Sep 29 12:10:32 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 1073741824" returned: 0 in 0.629s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:32 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 Sep 29 12:10:32 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:32 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3" returned: 0 in 0.355s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.678s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161562210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b37e69-894e-4906-8c1e-6270fee86aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:21Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Creating volume 80b37e69-894e-4906-8c1e-6270fee86aeb {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:32 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:32 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb 1073741824 Sep 29 12:10:32 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dbdbfc-1207-4c99-bdd3-403b399b8703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f48823d-028d-4497-986d-8592881a6bd3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719ef514-584b-42b2-abb9-d866f3122c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:33 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Volume volume-4f48823d-028d-4497-986d-8592881a6bd3 (4f48823d-028d-4497-986d-8592881a6bd3): created successfully Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719ef514-584b-42b2-abb9-d866f3122c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (93319b97-b812-4738-bffb-93d9e7ba0dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9bec1c79-43f4-434e-ad8c-1acb7b907610 tempest-CreateVolumesFromImageTest-1837723747 None] Created volume successfully. Sep 29 12:10:33 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb 1073741824" returned: 0 in 0.606s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:33 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb Sep 29 12:10:33 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:33 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb" returned: 0 in 0.287s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.050s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1209750262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f78265-f3ed-4bb1-8e55-f7d08cdfd14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:22Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Creating volume 91f78265-f3ed-4bb1-8e55-f7d08cdfd14e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:33 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:33 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e 1073741824 Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c239e7-9a31-41bb-8733-9421b01eedba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b37e69-894e-4906-8c1e-6270fee86aeb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:33 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6ff0d7-b24b-48d6-9646-986af5ec1ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:33 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Volume volume-80b37e69-894e-4906-8c1e-6270fee86aeb (80b37e69-894e-4906-8c1e-6270fee86aeb): created successfully Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6ff0d7-b24b-48d6-9646-986af5ec1ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (e07e2eff-0a46-469b-9674-8491f798f308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-646dd9b4-30aa-4fc6-8437-717e04fcf998 tempest-CreateVolumesFromImageTest-1837723747 None] Created volume successfully. Sep 29 12:10:34 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e 1073741824" returned: 0 in 0.524s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:34 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e Sep 29 12:10:34 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:34 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e" returned: 0 in 0.284s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.554s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723901348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3637b4a5-3323-43d3-908e-aaf55527843e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c210ae7aa24e1caf64283ecca1197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:22Z,use_quota=True,user_id='61b51a28bb914ef288df42ccfcd42337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Creating volume 3637b4a5-3323-43d3-908e-aaf55527843e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:34 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0784712e-ce49-4dd4-bdeb-62b09f7948fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:34 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e 1073741824 Sep 29 12:10:34 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979c545b-d760-42ef-9494-6386a14f5ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:34 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Volume volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e (91f78265-f3ed-4bb1-8e55-f7d08cdfd14e): created successfully Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979c545b-d760-42ef-9494-6386a14f5ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (02c1c0b1-9351-4f5e-a88c-2c63458c5655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-adebd1ab-5e87-4295-a585-58231e380fda tempest-CreateVolumesFromImageTest-1837723747 None] Created volume successfully. Sep 29 12:10:35 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e 1073741824" returned: 0 in 0.480s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:35 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e Sep 29 12:10:35 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:35 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e" returned: 0 in 0.345s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca5284f-41e5-40b0-bfa7-29cb31958e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3637b4a5-3323-43d3-908e-aaf55527843e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13474952-8f82-4732-b71b-abbbcdcec980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:35 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Volume volume-3637b4a5-3323-43d3-908e-aaf55527843e (3637b4a5-3323-43d3-908e-aaf55527843e): created successfully Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13474952-8f82-4732-b71b-abbbcdcec980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:35 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Flow 'volume_create_manager' (f1fe8e35-88fc-4dc2-94fd-96baddfae785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-09f9ef2a-1ec6-426f-9a02-def200973ba7 tempest-CreateVolumesFromImageTest-1837723747 None] Created volume successfully. Sep 29 12:10:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-3637b4a5-3323-43d3-908e-aaf55527843e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-3637b4a5-3323-43d3-908e-aaf55527843e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-quobyte-3637b4a5-3323-43d3-908e-aaf55527843e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-3637b4a5-3323-43d3-908e-aaf55527843e" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:36 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021c0a4-41ee-4f3c-92ee-34e9a440469c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:37 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e Sep 29 12:10:37 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:37 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e" returned: 0 in 0.468s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:37 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e Sep 29 12:10:37 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:37 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3637b4a5-3323-43d3-908e-aaf55527843e" returned: 0 in 0.272s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-3637b4a5-3323-43d3-908e-aaf55527843e" released by "delete_volume" :: held 0.790s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Created reservations ['33fcb2d6-fe83-4121-a593-22b95826ee2f', '7eafa3cf-3742-40f6-8e99-5baf56a8f094', '78e8d0f6-31c8-42d9-99ea-09c7a09a2270', '8ad27e7c-cff1-4ff3-844e-92fd716ffd86'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:37 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:37 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-quobyte-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d2ebb5-88be-4bf7-a1dc-9bc8e8ca33e0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:38 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.463s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:38 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Deleted volume successfully. Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-45c96422-ff49-4777-a974-6e485f807b21 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-3637b4a5-3323-43d3-908e-aaf55527843e-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:38 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e Sep 29 12:10:38 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:38 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e" returned: 0 in 0.463s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:38 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e Sep 29 12:10:38 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:38 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e" released by "delete_volume" :: held 0.786s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Created reservations ['c6447739-cc7c-409c-bff6-1e9458b164ed', '16cf3a16-2b9f-4bbb-8b80-da25ccbfee4c', '6c420f57-8403-4e47-ae85-744f80ebfb8d', '3f8e0f77-7641-4533-8b20-3b9bd1b08960'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:39 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:39 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-80b37e69-894e-4906-8c1e-6270fee86aeb-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-80b37e69-894e-4906-8c1e-6270fee86aeb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-quobyte-80b37e69-894e-4906-8c1e-6270fee86aeb" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-80b37e69-894e-4906-8c1e-6270fee86aeb" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce9b61c-96c9-468a-9e3b-d00003ab5c06]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:39 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.429s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Deleted volume successfully. Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a78d1e72-de13-49be-a71b-7a27356ba2bf tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-91f78265-f3ed-4bb1-8e55-f7d08cdfd14e-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:39 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb Sep 29 12:10:39 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:39 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb" returned: 0 in 0.453s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:39 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb Sep 29 12:10:39 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:40 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80b37e69-894e-4906-8c1e-6270fee86aeb" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-80b37e69-894e-4906-8c1e-6270fee86aeb" released by "delete_volume" :: held 0.815s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Created reservations ['729131af-a462-4cc1-9231-692ffd8ce7fb', '1903d94a-576d-47bb-8e12-538b9aadbbe3', '9dffd586-ac8e-43d9-96b8-bd1dababc215', 'd3b09c9e-eb30-42ea-8329-5dc8d7b93716'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:40 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:40 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:40 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.247s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Deleted volume successfully. Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-bd0081ef-1e1c-4e62-b964-5ed5da93da5c tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-80b37e69-894e-4906-8c1e-6270fee86aeb-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-4f48823d-028d-4497-986d-8592881a6bd3-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-4f48823d-028d-4497-986d-8592881a6bd3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-quobyte-4f48823d-028d-4497-986d-8592881a6bd3" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-4f48823d-028d-4497-986d-8592881a6bd3" acquired by "delete_volume" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28cbb1c-5dcc-4a1f-bea0-b689825c93d0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:40 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 Sep 29 12:10:40 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:41 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3" returned: 0 in 0.393s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:41 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3 Sep 29 12:10:41 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:41 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4f48823d-028d-4497-986d-8592881a6bd3" returned: 0 in 0.299s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-4f48823d-028d-4497-986d-8592881a6bd3" released by "delete_volume" :: held 0.752s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Created reservations ['9118c457-da0a-4362-a226-e648b2318b34', '971b6412-451a-4a04-8ed0-281ca73d32b9', '7d6687e1-c1e4-44ab-b4b2-01fb4f981ab1', '6157efe7-c266-43fd-a110-ada5f5282383'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:41 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:41 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-9d1021a1-65bf-4000-9c21-186a3ab2ccac-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-9d1021a1-65bf-4000-9c21-186a3ab2ccac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "cinder-quobyte-9d1021a1-65bf-4000-9c21-186a3ab2ccac" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:42 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-9d1021a1-65bf-4000-9c21-186a3ab2ccac" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Deleted volume successfully. Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[25147cf2-e891-4916-8070-040a263a2fce]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-27bba11b-9f9c-4895-bbdd-ff60864b9bc6 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-4f48823d-028d-4497-986d-8592881a6bd3-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:42 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac Sep 29 12:10:42 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:42 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac" returned: 0 in 0.425s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:42 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac Sep 29 12:10:42 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:42 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9d1021a1-65bf-4000-9c21-186a3ab2ccac" returned: 0 in 0.291s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-quobyte-9d1021a1-65bf-4000-9c21-186a3ab2ccac" released by "delete_volume" :: held 0.769s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Created reservations ['37bb0643-6b23-40fb-89ed-d79d49c06737', 'c1e049bf-abde-4d68-b975-bbc8f159642c', '8f9ef56e-436a-4537-a2cd-4ae6c32fd715', 'cfb705b2-2e60-4a08-b52f-7fd90632f193'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:42 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:42 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:43 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.297s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:43 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Deleted volume successfully. Sep 29 12:10:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2822c92d-5e73-4677-bb18-467d2c09b3e3 tempest-CreateVolumesFromImageTest-1837723747 None] Lock "cinder-9d1021a1-65bf-4000-9c21-186a3ab2ccac-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (61d23568-f8ae-4db4-aea0-9320c5841714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dd4e52-e640-42d8-85ba-36f58b78bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dd4e52-e640-42d8-85ba-36f58b78bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632332020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ed2afe-ce58-4807-a5e7-7ede454480aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:46Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f27917-7de7-4c53-b77b-8c6fa9269b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f27917-7de7-4c53-b77b-8c6fa9269b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dc86b9-3ee5-4857-9614-73eee821f9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dc86b9-3ee5-4857-9614-73eee821f9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ed2afe-ce58-4807-a5e7-7ede454480aa', 'volume_name': 'volume-85ed2afe-ce58-4807-a5e7-7ede454480aa', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ec5908-59db-4819-8d6a-359247c57f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ec5908-59db-4819-8d6a-359247c57f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255eb35a-b46e-48c3-91a7-ec0476071b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:46 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume 85ed2afe-ce58-4807-a5e7-7ede454480aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ed2afe-ce58-4807-a5e7-7ede454480aa', 'volume_size': 1} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632332020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ed2afe-ce58-4807-a5e7-7ede454480aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:46Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Creating volume 85ed2afe-ce58-4807-a5e7-7ede454480aa {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:46 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:46 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa 1073741824 Sep 29 12:10:46 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:46 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa 1073741824" returned: 0 in 0.535s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:46 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa Sep 29 12:10:46 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:47 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa" returned: 0 in 0.259s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255eb35a-b46e-48c3-91a7-ec0476071b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ed2afe-ce58-4807-a5e7-7ede454480aa', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0470e0-e247-4431-aa31-1912b79b7f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:47 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume volume-85ed2afe-ce58-4807-a5e7-7ede454480aa (85ed2afe-ce58-4807-a5e7-7ede454480aa): created successfully Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0470e0-e247-4431-aa31-1912b79b7f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (61d23568-f8ae-4db4-aea0-9320c5841714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:47 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6eef542b-3164-4f6c-a195-a83062727454 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created volume successfully. Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (f0be47fc-036e-4310-8f56-e12587fff304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23713eba-5463-4e88-a807-aa66a2b93b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23713eba-5463-4e88-a807-aa66a2b93b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304886347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3eb7f9-f27f-428a-8903-7e3b13e201ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:47Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e4857c-e005-4f5b-8fc4-0395c592dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e4857c-e005-4f5b-8fc4-0395c592dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f72968-08f4-47ce-be0a-b5f8e5dde1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f72968-08f4-47ce-be0a-b5f8e5dde1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3eb7f9-f27f-428a-8903-7e3b13e201ae', 'volume_name': 'volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f49153-cc26-48d5-a034-0e6194bbfbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f49153-cc26-48d5-a034-0e6194bbfbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc8bc8e-ab13-43d7-b62e-9a77551da8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:47 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Volume 5b3eb7f9-f27f-428a-8903-7e3b13e201ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae', 'volume_size': 1} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304886347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3eb7f9-f27f-428a-8903-7e3b13e201ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:47Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Creating volume 5b3eb7f9-f27f-428a-8903-7e3b13e201ae {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:47 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:47 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae 1073741824 Sep 29 12:10:47 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:47 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae 1073741824" returned: 0 in 0.437s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:47 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae Sep 29 12:10:47 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:48 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc8bc8e-ab13-43d7-b62e-9a77551da8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298a477c-8064-4055-aeca-62c1d42b1f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:48 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Volume volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae (5b3eb7f9-f27f-428a-8903-7e3b13e201ae): created successfully Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298a477c-8064-4055-aeca-62c1d42b1f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (f0be47fc-036e-4310-8f56-e12587fff304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8e32d9e5-805b-4f9b-a260-7ba823f2161f tempest-ProjectReaderTests-184342338 None] Created volume successfully. Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (98ee168f-5147-4a72-84cf-1268d417c85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48200cb-e3ca-4b1f-81aa-d6e1e76a0bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48200cb-e3ca-4b1f-81aa-d6e1e76a0bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-521924469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d985ff-29aa-4ff2-8174-a17fd6ece911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:49Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f391e8-51b8-439a-be15-84443c9dba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f391e8-51b8-439a-be15-84443c9dba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfdd463-a97c-499b-9327-363351f0d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfdd463-a97c-499b-9327-363351f0d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d985ff-29aa-4ff2-8174-a17fd6ece911', 'volume_name': 'volume-09d985ff-29aa-4ff2-8174-a17fd6ece911', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe221947-dd5a-4f9d-b3e0-4df0879b2ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe221947-dd5a-4f9d-b3e0-4df0879b2ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff525e7a-891e-444f-b525-574cafd73ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:48 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume 09d985ff-29aa-4ff2-8174-a17fd6ece911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d985ff-29aa-4ff2-8174-a17fd6ece911', 'volume_size': 1} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-521924469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d985ff-29aa-4ff2-8174-a17fd6ece911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:49Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Creating volume 09d985ff-29aa-4ff2-8174-a17fd6ece911 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:48 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:48 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 1073741824 Sep 29 12:10:48 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (ef11fb36-056f-43dd-aede-833e715e22c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b63ae3a-fd4a-444d-83c5-d761fd7bf8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b63ae3a-fd4a-444d-83c5-d761fd7bf8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44987011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881f7d5-99a5-4bee-b220-858a5a460a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:49Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1995b6e4-1ade-4adb-a641-43298d67269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1995b6e4-1ade-4adb-a641-43298d67269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49708480-19ca-4c89-9cae-0c9bd0d0a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49708480-19ca-4c89-9cae-0c9bd0d0a5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3881f7d5-99a5-4bee-b220-858a5a460a93', 'volume_name': 'volume-3881f7d5-99a5-4bee-b220-858a5a460a93', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60204210-07c9-4806-a18f-75b2cca262d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60204210-07c9-4806-a18f-75b2cca262d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43af31d1-0ba5-45fd-a6f4-9ecc1bc60497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume 3881f7d5-99a5-4bee-b220-858a5a460a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3881f7d5-99a5-4bee-b220-858a5a460a93', 'volume_size': 1} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:49 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 1073741824" returned: 0 in 0.655s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:49 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 Sep 29 12:10:49 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (66696b10-cfba-4267-8a7f-7d03d7b6bcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cfe705-3ca1-430c-99f1-c1780779e7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cfe705-3ca1-430c-99f1-c1780779e7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447905232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82add8d0-b894-4a33-ac20-d2eebfd55bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:50Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35646c45-49fc-4615-8dc0-988123fc155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35646c45-49fc-4615-8dc0-988123fc155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0007f4dc-0e5b-485f-a021-ab2d424eb9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0007f4dc-0e5b-485f-a021-ab2d424eb9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82add8d0-b894-4a33-ac20-d2eebfd55bfc', 'volume_name': 'volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8743144f-8627-453e-9207-c1eeac7828bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8743144f-8627-453e-9207-c1eeac7828bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be71cd-622d-46cd-b8b4-01405cd3484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume 82add8d0-b894-4a33-ac20-d2eebfd55bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc', 'volume_size': 1} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-5b3eb7f9-f27f-428a-8903-7e3b13e201ae-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Lock "cinder-5b3eb7f9-f27f-428a-8903-7e3b13e201ae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-quobyte-5b3eb7f9-f27f-428a-8903-7e3b13e201ae" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:50 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911" returned: 0 in 0.492s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44987011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881f7d5-99a5-4bee-b220-858a5a460a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:49Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Creating volume 3881f7d5-99a5-4bee-b220-858a5a460a93 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:50 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-5b3eb7f9-f27f-428a-8903-7e3b13e201ae" acquired by "delete_volume" :: waited 0.059s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:50 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 1073741824 Sep 29 12:10:50 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff525e7a-891e-444f-b525-574cafd73ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d985ff-29aa-4ff2-8174-a17fd6ece911', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcc5324-9c6a-41bd-9908-f41ae990c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9affcfc1-b846-4a09-b088-3adb39410f46]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 (09d985ff-29aa-4ff2-8174-a17fd6ece911): created successfully Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcc5324-9c6a-41bd-9908-f41ae990c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (98ee168f-5147-4a72-84cf-1268d417c85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8c159342-8a57-472a-91fb-ca2b689ad683 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created volume successfully. Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (56745937-c0e3-4d5b-bd4b-678f944b6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eb3546-c193-49b2-bbf5-9f0769c64d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae Sep 29 12:10:50 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eb3546-c193-49b2-bbf5-9f0769c64d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1577254388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b895870e-1ffa-4912-9574-cf3dc64d92e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:50Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19265bdc-3251-428b-a7d3-74b4e694c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19265bdc-3251-428b-a7d3-74b4e694c036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9759dd-afb5-47c8-a443-bcf12eb3a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9759dd-afb5-47c8-a443-bcf12eb3a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b895870e-1ffa-4912-9574-cf3dc64d92e3', 'volume_name': 'volume-b895870e-1ffa-4912-9574-cf3dc64d92e3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8564735f-685c-44f4-bf61-7722d4f6d1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8564735f-685c-44f4-bf61-7722d4f6d1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48661a26-9245-4709-9307-60308719df4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume b895870e-1ffa-4912-9574-cf3dc64d92e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b895870e-1ffa-4912-9574-cf3dc64d92e3', 'volume_size': 1} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:50 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (2f7be64f-ad11-4d25-b930-b30ff107a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42acaef7-93ad-48b2-973f-6862a4d0b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae" returned: 0 in 0.631s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:50 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42acaef7-93ad-48b2-973f-6862a4d0b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61029703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80832158-95d8-44d7-a991-a28909e79749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:51Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae Sep 29 12:10:50 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e08273-8477-4413-855b-62d2794bae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e08273-8477-4413-855b-62d2794bae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586ffd62-6a78-4195-83d6-d25ccf8942ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586ffd62-6a78-4195-83d6-d25ccf8942ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80832158-95d8-44d7-a991-a28909e79749', 'volume_name': 'volume-80832158-95d8-44d7-a991-a28909e79749', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2116faed-03b9-48ea-9e9e-b5a3e5c2b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2116faed-03b9-48ea-9e9e-b5a3e5c2b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed1b5f9-da22-43eb-bd06-58642bab0ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume 80832158-95d8-44d7-a991-a28909e79749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80832158-95d8-44d7-a991-a28909e79749', 'volume_size': 1} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 1073741824" returned: 0 in 0.794s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:50 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 Sep 29 12:10:50 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:51 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5b3eb7f9-f27f-428a-8903-7e3b13e201ae" returned: 0 in 0.293s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-5b3eb7f9-f27f-428a-8903-7e3b13e201ae" released by "delete_volume" :: held 1.018s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Created reservations ['777b1bf1-1264-4f96-abe6-d9a21836ede0', '34dba0c3-9be1-4813-9bd6-f82661e9f29b', 'c5fcab04-c30e-4e0c-94cb-4f569171941b', '17fe21c5-7586-471a-b0b4-9586a23061b6'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:51 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93" returned: 0 in 0.298s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447905232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82add8d0-b894-4a33-ac20-d2eebfd55bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:50Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Creating volume 82add8d0-b894-4a33-ac20-d2eebfd55bfc {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:51 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43af31d1-0ba5-45fd-a6f4-9ecc1bc60497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3881f7d5-99a5-4bee-b220-858a5a460a93', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:51 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc 1073741824 Sep 29 12:10:51 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02da7734-4580-4ce8-9c5c-2d35cf9dca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume volume-3881f7d5-99a5-4bee-b220-858a5a460a93 (3881f7d5-99a5-4bee-b220-858a5a460a93): created successfully Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02da7734-4580-4ce8-9c5c-2d35cf9dca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (ef11fb36-056f-43dd-aede-833e715e22c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-48eeae09-100d-4de8-88ee-699c7ccde9e5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created volume successfully. Sep 29 12:10:51 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:51 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:51 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.276s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Deleted volume successfully. Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4a145635-3f6f-4a75-8dbe-d295cc1793cd tempest-ProjectReaderTests-184342338 None] Lock "cinder-5b3eb7f9-f27f-428a-8903-7e3b13e201ae-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:51 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc 1073741824" returned: 0 in 0.514s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:51 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc Sep 29 12:10:51 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:52 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc" returned: 0 in 0.267s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1577254388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b895870e-1ffa-4912-9574-cf3dc64d92e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:50Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Creating volume b895870e-1ffa-4912-9574-cf3dc64d92e3 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:52 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:52 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 1073741824 Sep 29 12:10:52 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be71cd-622d-46cd-b8b4-01405cd3484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94317e55-019c-4078-8195-f31d8d397762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc (82add8d0-b894-4a33-ac20-d2eebfd55bfc): created successfully Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94317e55-019c-4078-8195-f31d8d397762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (66696b10-cfba-4267-8a7f-7d03d7b6bcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:52 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2216bc9e-f03e-47c7-a06f-662321dd5587 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created volume successfully. Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:52 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (9565f555-880a-4b66-9e41-68666f0994ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a76b36-c123-4cbd-9223-775bb841d477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 1073741824" returned: 0 in 0.596s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a76b36-c123-4cbd-9223-775bb841d477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293269743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2ff656-2c9b-4981-b7f8-819fe23cd697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:53Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c925f1c-531b-4c6c-9340-e0f2451b7f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c925f1c-531b-4c6c-9340-e0f2451b7f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8b0fb5-9975-4d9e-829d-e573e005e040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8b0fb5-9975-4d9e-829d-e573e005e040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2ff656-2c9b-4981-b7f8-819fe23cd697', 'volume_name': 'volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d854aea3-d43e-4442-b114-553372ef0c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d854aea3-d43e-4442-b114-553372ef0c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad080462-93de-4faa-bb5f-3678a41f3e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Volume 9e2ff656-2c9b-4981-b7f8-819fe23cd697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697', 'volume_size': 1} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:52 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 Sep 29 12:10:52 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:53 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3" returned: 0 in 0.291s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61029703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80832158-95d8-44d7-a991-a28909e79749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba835e6d72df473eb487e6f6b39dc042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:51Z,use_quota=True,user_id='f38eaf1dbeaa443c9821a3cdf542c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Creating volume 80832158-95d8-44d7-a991-a28909e79749 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:53 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48661a26-9245-4709-9307-60308719df4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b895870e-1ffa-4912-9574-cf3dc64d92e3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0145bba-2353-4c5f-92df-cd6e78a00d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:53 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 1073741824 Sep 29 12:10:53 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 (b895870e-1ffa-4912-9574-cf3dc64d92e3): created successfully Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0145bba-2353-4c5f-92df-cd6e78a00d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (56745937-c0e3-4d5b-bd4b-678f944b6d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a3141d36-83a1-4a63-93f8-a993a40efb4c tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created volume successfully. Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-934536a2-c5d4-407f-ae43-5b767d614d70 req-c0a5e5be-928d-4647-9630-40515a82fca2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:53 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 1073741824" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:53 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 Sep 29 12:10:53 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:53 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.071s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293269743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2ff656-2c9b-4981-b7f8-819fe23cd697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:53Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Creating volume 9e2ff656-2c9b-4981-b7f8-819fe23cd697 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:53 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed1b5f9-da22-43eb-bd06-58642bab0ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80832158-95d8-44d7-a991-a28909e79749', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:53 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 1073741824 Sep 29 12:10:53 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ad713d-6a99-40dc-a49c-c990dc0703d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Volume volume-80832158-95d8-44d7-a991-a28909e79749 (80832158-95d8-44d7-a991-a28909e79749): created successfully Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ad713d-6a99-40dc-a49c-c990dc0703d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Flow 'volume_create_manager' (2f7be64f-ad11-4d25-b930-b30ff107a75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-434a1e11-d6c6-4c52-8185-fdc66a145de6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created volume successfully. Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-80832158-95d8-44d7-a991-a28909e79749-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-80832158-95d8-44d7-a991-a28909e79749-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-quobyte-80832158-95d8-44d7-a991-a28909e79749" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-80832158-95d8-44d7-a991-a28909e79749" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c98a291-4787-43cc-a361-6874f4922e2b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:54 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 1073741824" returned: 0 in 0.485s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:54 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 Sep 29 12:10:54 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:54 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 Sep 29 12:10:54 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:54 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749" returned: 0 in 0.370s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:54 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697" returned: 0 in 0.257s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-934536a2-c5d4-407f-ae43-5b767d614d70 req-c0a5e5be-928d-4647-9630-40515a82fca2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.297s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:54 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749 Sep 29 12:10:54 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-934536a2-c5d4-407f-ae43-5b767d614d70 req-c0a5e5be-928d-4647-9630-40515a82fca2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad080462-93de-4faa-bb5f-3678a41f3e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887a8984-3d17-4129-9a2c-e93d6860fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:54 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Volume volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 (9e2ff656-2c9b-4981-b7f8-819fe23cd697): created successfully Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887a8984-3d17-4129-9a2c-e93d6860fe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (9565f555-880a-4b66-9e41-68666f0994ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-934536a2-c5d4-407f-ae43-5b767d614d70 req-c0a5e5be-928d-4647-9630-40515a82fca2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-55713b50-5777-4740-b672-d8dee8a8c65d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b8af720-2df3-4dbf-bb86-172e7daf7bc2', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:10:54 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-40e52d7b-ac07-4b3e-8c86-e41ac768103c tempest-ProjectReaderTests-184342338 None] Created volume successfully. Sep 29 12:10:54 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-934536a2-c5d4-407f-ae43-5b767d614d70 req-c0a5e5be-928d-4647-9630-40515a82fca2 tempest-TestServerVolumeAttachmentScenario-250069272 None] attachment_update completed successfully. Sep 29 12:10:54 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-80832158-95d8-44d7-a991-a28909e79749" returned: 0 in 0.297s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-80832158-95d8-44d7-a991-a28909e79749" released by "delete_volume" :: held 0.725s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created reservations ['1ac769e7-9076-4f87-8b6f-499c16716278', '8cf931c7-a2e5-4b52-930b-a552c937ba3f', 'd00b5146-ee94-4adc-8291-02707bad03a6', '1f4a61ec-b7e4-4eda-b808-43db68ba3894'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:55 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:55 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:55 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.278s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-b895870e-1ffa-4912-9574-cf3dc64d92e3-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Deleted volume successfully. Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-b895870e-1ffa-4912-9574-cf3dc64d92e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-23c1f09f-0558-40a8-bc2a-df8dbe92010b tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-80832158-95d8-44d7-a991-a28909e79749-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-quobyte-b895870e-1ffa-4912-9574-cf3dc64d92e3" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-b895870e-1ffa-4912-9574-cf3dc64d92e3" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[34551b46-0d2c-4215-8cfe-063662166e50]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:55 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 Sep 29 12:10:55 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:55 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-9e2ff656-2c9b-4981-b7f8-819fe23cd697-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3" returned: 0 in 0.423s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Lock "cinder-9e2ff656-2c9b-4981-b7f8-819fe23cd697-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:55 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3 Sep 29 12:10:55 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-quobyte-9e2ff656-2c9b-4981-b7f8-819fe23cd697" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-9e2ff656-2c9b-4981-b7f8-819fe23cd697" acquired by "delete_volume" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6e82e9-68a0-4f3c-b3b1-48556105f33c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:56 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 Sep 29 12:10:56 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:56 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b895870e-1ffa-4912-9574-cf3dc64d92e3" returned: 0 in 0.252s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-b895870e-1ffa-4912-9574-cf3dc64d92e3" released by "delete_volume" :: held 0.720s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created reservations ['e74897e5-8b94-4309-957c-b06048dc4f97', '84b1ff25-d709-4dac-a831-5b60d96d6d62', '0bd5241b-89e1-43e6-8e7d-d27ebe824117', '3d665366-1e1b-4169-8699-7107f2cd408f'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:56 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:56 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:56 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697" returned: 0 in 0.398s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:56 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697 Sep 29 12:10:56 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-82add8d0-b894-4a33-ac20-d2eebfd55bfc-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-82add8d0-b894-4a33-ac20-d2eebfd55bfc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:56 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.298s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:56 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Deleted volume successfully. Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-quobyte-82add8d0-b894-4a33-ac20-d2eebfd55bfc" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e852386c-607c-4c51-a560-c5f636180616 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-b895870e-1ffa-4912-9574-cf3dc64d92e3-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-82add8d0-b894-4a33-ac20-d2eebfd55bfc" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fbfe88-7e97-4b2f-9658-71853714dc29]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:56 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9e2ff656-2c9b-4981-b7f8-819fe23cd697" returned: 0 in 0.314s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-9e2ff656-2c9b-4981-b7f8-819fe23cd697" released by "delete_volume" :: held 0.775s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:56 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc Sep 29 12:10:56 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Created reservations ['2cc7d554-ccf6-43a6-bcf3-b7e5b9f86ac0', 'fad6db6d-d05e-4ffb-8238-5d656d019409', '4c7fdf08-2d7c-4b4c-bfd2-b0fd6a8174a0', '5a2b485d-76e7-4406-a73f-284695bdaa14'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:56 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:56 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:57 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc" returned: 0 in 0.446s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:57 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc Sep 29 12:10:57 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:57 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.321s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Deleted volume successfully. Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ca94b6b6-be4c-4962-911b-7672dd5fcf27 tempest-ProjectReaderTests-184342338 None] Lock "cinder-9e2ff656-2c9b-4981-b7f8-819fe23cd697-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:57 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-82add8d0-b894-4a33-ac20-d2eebfd55bfc" returned: 0 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-82add8d0-b894-4a33-ac20-d2eebfd55bfc" released by "delete_volume" :: held 0.841s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created reservations ['2e21bb0d-b7c3-4256-b078-1de75f96e297', 'df9616de-8235-4310-8e45-6ef2f4ee4bf4', 'f7a60ff1-6d72-4bf8-a794-5f8040dda1e5', '5b79a89b-ea73-4f55-8ccd-ff2bf764a549'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:10:57 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:57 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (906dbcde-be1b-4472-9dff-a485726aa11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9c45f8-d7e7-4b7f-a49c-19ac52649132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9c45f8-d7e7-4b7f-a49c-19ac52649132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420764085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abc4424-dfb1-4d87-a049-86ada8e875c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:58Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda90934-53b0-494e-89a7-faeb3d53c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda90934-53b0-494e-89a7-faeb3d53c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd13a4a-7bfd-40cb-812a-9973c27d9ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd13a4a-7bfd-40cb-812a-9973c27d9ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abc4424-dfb1-4d87-a049-86ada8e875c3', 'volume_name': 'volume-6abc4424-dfb1-4d87-a049-86ada8e875c3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6534f3-f838-49b7-b55c-2923a5bb44f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6534f3-f838-49b7-b55c-2923a5bb44f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef589ad5-e8c4-4e27-893e-b99b301cb2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Volume 6abc4424-dfb1-4d87-a049-86ada8e875c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abc4424-dfb1-4d87-a049-86ada8e875c3', 'volume_size': 1} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420764085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abc4424-dfb1-4d87-a049-86ada8e875c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:10:58Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Creating volume 6abc4424-dfb1-4d87-a049-86ada8e875c3 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:10:57 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-3881f7d5-99a5-4bee-b220-858a5a460a93-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:57 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 1073741824 Sep 29 12:10:57 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-3881f7d5-99a5-4bee-b220-858a5a460a93-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-quobyte-3881f7d5-99a5-4bee-b220-858a5a460a93" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-3881f7d5-99a5-4bee-b220-858a5a460a93" acquired by "delete_volume" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:57 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:57 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Deleted volume successfully. Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3bd758-7076-4f81-bec0-5bad63cb2cdf]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5758c893-71c3-4319-bae6-217d1a7e6bd5 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-82add8d0-b894-4a33-ac20-d2eebfd55bfc-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:58 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 Sep 29 12:10:58 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:58 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:58 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93" returned: 0 in 0.450s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 1073741824" returned: 0 in 0.651s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:58 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93 Sep 29 12:10:58 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:58 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 Sep 29 12:10:58 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:58 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3881f7d5-99a5-4bee-b220-858a5a460a93" returned: 0 in 0.285s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-3881f7d5-99a5-4bee-b220-858a5a460a93" released by "delete_volume" :: held 0.801s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:58 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created reservations ['f0792c31-cbb4-460f-a6b7-d51a90785a9d', 'fba16b7e-5eb4-47cc-b14d-f181211951f6', 'fb1eb72d-b78f-425b-9e41-f0dd509f4169', '7b1c5d10-efb9-4f0c-a484-412a11dd4044'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3" returned: 0 in 0.307s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef589ad5-e8c4-4e27-893e-b99b301cb2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abc4424-dfb1-4d87-a049-86ada8e875c3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5c61c0-bd51-4788-b9bf-da2141748f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:10:58 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Volume volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 (6abc4424-dfb1-4d87-a049-86ada8e875c3): created successfully Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5c61c0-bd51-4788-b9bf-da2141748f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (906dbcde-be1b-4472-9dff-a485726aa11b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:10:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-da7badb9-a78d-4348-b0cc-28e721972f38 tempest-ProjectReaderTests-184342338 None] Created volume successfully. Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:58 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:10:58 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-09d985ff-29aa-4ff2-8174-a17fd6ece911-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-09d985ff-29aa-4ff2-8174-a17fd6ece911-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-quobyte-09d985ff-29aa-4ff2-8174-a17fd6ece911" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-09d985ff-29aa-4ff2-8174-a17fd6ece911" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7513731e-6928-4558-a318-43024b5593cb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:59 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 Sep 29 12:10:59 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:59 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.369s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:10:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Deleted volume successfully. Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e4eab0f6-f541-4661-b546-e83dc84b039f tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-3881f7d5-99a5-4bee-b220-858a5a460a93-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-ae649300-543c-4d24-bef6-20230232875d req-0ba7ad35-54bf-40f7-90bb-cecb4162bfb2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-ae649300-543c-4d24-bef6-20230232875d req-0ba7ad35-54bf-40f7-90bb-cecb4162bfb2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [req-ae649300-543c-4d24-bef6-20230232875d req-0ba7ad35-54bf-40f7-90bb-cecb4162bfb2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-ae649300-543c-4d24-bef6-20230232875d req-0ba7ad35-54bf-40f7-90bb-cecb4162bfb2 tempest-TestServerVolumeAttachmentScenario-250069272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d', 'name': 'volume-182535f1-35f9-40b0-845e-cb28cf23bac8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0a92406-e387-42af-bff2-f8f5acb49f85', 'enforce_multipath': True} {{(pid=86117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 12:10:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-ae649300-543c-4d24-bef6-20230232875d req-0ba7ad35-54bf-40f7-90bb-cecb4162bfb2 tempest-TestServerVolumeAttachmentScenario-250069272 None] attachment_update completed successfully. Sep 29 12:10:59 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911" returned: 0 in 0.417s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:59 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911 Sep 29 12:10:59 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-6abc4424-dfb1-4d87-a049-86ada8e875c3-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Lock "cinder-6abc4424-dfb1-4d87-a049-86ada8e875c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:59 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-quobyte-6abc4424-dfb1-4d87-a049-86ada8e875c3" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09d985ff-29aa-4ff2-8174-a17fd6ece911" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-09d985ff-29aa-4ff2-8174-a17fd6ece911" released by "delete_volume" :: held 0.787s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-6abc4424-dfb1-4d87-a049-86ada8e875c3" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe55d5-bec4-430a-92cc-9456e0ab44e4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:10:59 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created reservations ['2b1c5cc1-6804-4224-b0d5-3712f634f991', '48180d7d-1745-43aa-b129-6c494be1fe96', '97865430-b281-4d2d-a085-d041061ac473', 'a7e4a135-907c-474e-9a73-6124618b48d3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:00 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 Sep 29 12:11:00 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:00 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:00 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-85ed2afe-ce58-4807-a5e7-7ede454480aa-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-85ed2afe-ce58-4807-a5e7-7ede454480aa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "cinder-quobyte-85ed2afe-ce58-4807-a5e7-7ede454480aa" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-85ed2afe-ce58-4807-a5e7-7ede454480aa" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54dfce-6947-46ea-88da-7ee1ee87ad19]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:00 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3" returned: 0 in 0.599s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:00 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3 Sep 29 12:11:00 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:00 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.499s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Deleted volume successfully. Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb7eddb9-83c0-47af-a11a-683a66b89db6 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-09d985ff-29aa-4ff2-8174-a17fd6ece911-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:00 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa Sep 29 12:11:00 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:00 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6abc4424-dfb1-4d87-a049-86ada8e875c3" returned: 0 in 0.347s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-6abc4424-dfb1-4d87-a049-86ada8e875c3" released by "delete_volume" :: held 1.008s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Created reservations ['cc17648d-895d-4f10-9993-ffb71289b819', '8633d258-c402-4cdb-bf78-fd65b1322b5c', '39739b25-4422-45c7-9e61-af82048fe2f2', 'afebf278-2eac-4811-9fcf-2236f0560873'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:01 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa" returned: 0 in 0.495s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:01 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa Sep 29 12:11:01 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:01 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:01 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:01 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-85ed2afe-ce58-4807-a5e7-7ede454480aa" returned: 0 in 0.253s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-quobyte-85ed2afe-ce58-4807-a5e7-7ede454480aa" released by "delete_volume" :: held 0.813s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:01 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.266s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Deleted volume successfully. Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Created reservations ['86ae40ef-e9b2-47e2-a224-1aa3e8828a7d', '79854793-f3ef-4001-a82f-d0e636602e81', 'c05d3801-3170-4c84-b5de-7e7b2f295ae6', 'aed4d111-11ce-4f28-b0cc-cc208170c933'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dd96d05f-20eb-42a2-b01a-aaa547966b2b tempest-ProjectReaderTests-184342338 None] Lock "cinder-6abc4424-dfb1-4d87-a049-86ada8e875c3-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:01 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:01 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:01 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.257s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Deleted volume successfully. Sep 29 12:11:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-235ad794-1f63-41b4-b244-95b5d6712806 tempest-CreateVolumesFromSourceVolumeTest-132013532 None] Lock "cinder-85ed2afe-ce58-4807-a5e7-7ede454480aa-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-bdfd84a1-1904-4054-98b5-c46916c74476 req-f1d60178-fe74-40b1-ab97-339abe71afd6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Terminate volume connection completed successfully. Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-bdfd84a1-1904-4054-98b5-c46916c74476 req-f1d60178-fe74-40b1-ab97-339abe71afd6 tempest-TestServerVolumeAttachmentScenario-250069272 None] Deleting attachment a0a92406-e387-42af-bff2-f8f5acb49f85. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (a4e911bb-afb1-45cd-b6ad-465685e285d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb998d6f-4d31-419e-a3da-04ef5aa0328f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb998d6f-4d31-419e-a3da-04ef5aa0328f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1600480262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3353c8fd-0560-4374-a0fb-2a69e78bfee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:03Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c000b09-bc1d-4ffc-b425-bd8ba9820a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c000b09-bc1d-4ffc-b425-bd8ba9820a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38d7cb-d31c-4fe8-8fee-5fc66535402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38d7cb-d31c-4fe8-8fee-5fc66535402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3353c8fd-0560-4374-a0fb-2a69e78bfee6', 'volume_name': 'volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2202ddd-f711-4eaf-b63b-c60451ccdb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2202ddd-f711-4eaf-b63b-c60451ccdb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ce9f26-aa13-4292-ac42-38c897cea118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:02 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Volume 3353c8fd-0560-4374-a0fb-2a69e78bfee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6', 'volume_size': 1} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1600480262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3353c8fd-0560-4374-a0fb-2a69e78bfee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7e9a86db149c09957c98b3a4b6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:03Z,use_quota=True,user_id='c75525cb03db41dbaa4ec880a68aec70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Creating volume 3353c8fd-0560-4374-a0fb-2a69e78bfee6 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:02 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:02 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 1073741824 Sep 29 12:11:02 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:03 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 1073741824" returned: 0 in 0.566s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:03 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 Sep 29 12:11:03 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:03 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6" returned: 0 in 0.378s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ce9f26-aa13-4292-ac42-38c897cea118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d970eef6-e248-4a57-b075-5cdad6e5cd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:03 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Volume volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 (3353c8fd-0560-4374-a0fb-2a69e78bfee6): created successfully Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d970eef6-e248-4a57-b075-5cdad6e5cd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Flow 'volume_create_manager' (a4e911bb-afb1-45cd-b6ad-465685e285d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e4338f9c-159b-46f2-8df6-5d9c3f49cde2 tempest-ProjectReaderTests-184342338 None] Created volume successfully. Sep 29 12:11:04 devstack cinder-volume[86117]: INFO cinder.volume.manager [req-d14ebbe6-b31e-4a96-8351-1fdc7b168c00 req-f6a05f44-390a-4f9a-a85b-fb2f0296df6f tempest-TestServerVolumeAttachmentScenario-250069272 None] Terminate volume connection completed successfully. Sep 29 12:11:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [req-d14ebbe6-b31e-4a96-8351-1fdc7b168c00 req-f6a05f44-390a-4f9a-a85b-fb2f0296df6f tempest-TestServerVolumeAttachmentScenario-250069272 None] Deleting attachment 9b8af720-2df3-4dbf-bb86-172e7daf7bc2. {{(pid=86117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 12:11:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-3353c8fd-0560-4374-a0fb-2a69e78bfee6-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Lock "cinder-3353c8fd-0560-4374-a0fb-2a69e78bfee6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Acquiring lock "cinder-quobyte-3353c8fd-0560-4374-a0fb-2a69e78bfee6" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-3353c8fd-0560-4374-a0fb-2a69e78bfee6" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3b4f6f-4c88-4300-b717-e22577fbeee7]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:05 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 Sep 29 12:11:05 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:05 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6" returned: 0 in 0.454s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:05 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6 Sep 29 12:11:05 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:05 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3353c8fd-0560-4374-a0fb-2a69e78bfee6" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Lock "cinder-quobyte-3353c8fd-0560-4374-a0fb-2a69e78bfee6" released by "delete_volume" :: held 0.934s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Created reservations ['d8d37f94-a472-4266-9606-e8da9f715395', 'c3f0a8c8-a851-4ab1-95ad-77a3a9c99fbc', '2ff02c4a-ed4f-4857-8822-ef2d1eb07317', 'e05f8b2e-224c-4e40-bd0b-8deeb3956a25'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:05 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:05 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:06 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.502s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:06 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Deleted volume successfully. Sep 29 12:11:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2e51a887-281d-4fcc-a4e1-b57d34eb7711 tempest-ProjectReaderTests-184342338 None] Lock "cinder-3353c8fd-0560-4374-a0fb-2a69e78bfee6-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Flow 'volume_create_manager' (b4a6355f-058b-417e-8853-8a260778ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d472e52a-960b-4649-ac5c-21010b05503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d472e52a-960b-4649-ac5c-21010b05503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09346c6c-b2cd-462f-9bc5-010a3bce6aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6bd63a935d4f9a9178a2858e355849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:08Z,use_quota=True,user_id='5036ee414cd348d09801ee65ad392767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bd280a-6e00-4172-8e6f-b5392ee0a28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bd280a-6e00-4172-8e6f-b5392ee0a28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0278758e-3acc-4cd7-9a00-b39762bdc25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0278758e-3acc-4cd7-9a00-b39762bdc25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09346c6c-b2cd-462f-9bc5-010a3bce6aa9', 'volume_name': 'volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9', 'volume_size': 1, 'image_id': 'cceca99f-99b0-40f3-9848-780af1ce7961', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceca99f-99b0-40f3-9848-780af1ce7961', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af454745a7efe3c328f1b55f705704fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b6bd63a935d4f9a9178a2858e355849', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '481ca643ab0ffb3e13ed9a8ed7cf4f00285f8b91a0a3c1e743c25f57edb42ba3706bd94743f54b00617e6a1dfb71d3a3b442460aa98188993a4100c90abc4e06', 'id': 'cceca99f-99b0-40f3-9848-780af1ce7961', 'created_at': datetime.datetime(2026, 9, 29, 10, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceca99f-99b0-40f3-9848-780af1ce7961/file', 'properties': {}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71f9945-0c5c-4a4e-a67b-87851e33a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71f9945-0c5c-4a4e-a67b-87851e33a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de0b45e-061c-4f12-80fe-70e9158545ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Volume 09346c6c-b2cd-462f-9bc5-010a3bce6aa9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9', 'volume_size': 1, 'image_id': 'cceca99f-99b0-40f3-9848-780af1ce7961', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceca99f-99b0-40f3-9848-780af1ce7961', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af454745a7efe3c328f1b55f705704fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b6bd63a935d4f9a9178a2858e355849', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '481ca643ab0ffb3e13ed9a8ed7cf4f00285f8b91a0a3c1e743c25f57edb42ba3706bd94743f54b00617e6a1dfb71d3a3b442460aa98188993a4100c90abc4e06', 'id': 'cceca99f-99b0-40f3-9848-780af1ce7961', 'created_at': datetime.datetime(2026, 9, 29, 10, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceca99f-99b0-40f3-9848-780af1ce7961/file', 'properties': {}}, 'image_service': } Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Trying to clone 09346c6c-b2cd-462f-9bc5-010a3bce6aa9 from image cceca99f-99b0-40f3-9848-780af1ce7961 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cceca99f-99b0-40f3-9848-780af1ce7961', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:11:08 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:11:08 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa369d1-bd6a-404d-a061-4d8b4464ea58]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:09 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD Sep 29 12:11:09 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "cinder-182535f1-35f9-40b0-845e-cb28cf23bac8-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-182535f1-35f9-40b0-845e-cb28cf23bac8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "cinder-quobyte-182535f1-35f9-40b0-845e-cb28cf23bac8" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-quobyte-182535f1-35f9-40b0-845e-cb28cf23bac8" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00f724a-110f-40ba-9508-9877de96f144]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:09 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:09 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 Sep 29 12:11:09 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:09 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD Sep 29 12:11:09 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:09 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8" returned: 0 in 0.356s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:09 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8 Sep 29 12:11:09 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:09 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Temporary image cceca99f-99b0-40f3-9848-780af1ce7961 is fetched for user 5036ee414cd348d09801ee65ad392767. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b58f345-e317-4859-bf68-c949b33e0e8c]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:09 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-182535f1-35f9-40b0-845e-cb28cf23bac8" returned: 0 in 0.264s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:09 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD Sep 29 12:11:09 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-quobyte-182535f1-35f9-40b0-845e-cb28cf23bac8" released by "delete_volume" :: held 0.672s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Created reservations ['6ee43648-e03f-4171-9f05-aba8a5db1e05', '89ef6749-cd6d-47de-9be6-a9a4390482cd', 'c27fd59d-5d7d-48f8-9343-e6b263690b2d', '6b5fa63f-2a68-4a1b-b8c2-fb6d68c2ee8c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:10 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:10 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:10 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:10 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD Sep 29 12:11:10 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:10 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Deleted volume successfully. Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "cinder-55713b50-5777-4740-b672-d8dee8a8c65d-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0172e2dd-3a1d-4133-8625-6f32158335cd tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-182535f1-35f9-40b0-845e-cb28cf23bac8-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-55713b50-5777-4740-b672-d8dee8a8c65d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "cinder-quobyte-55713b50-5777-4740-b672-d8dee8a8c65d" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-quobyte-55713b50-5777-4740-b672-d8dee8a8c65d" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9bea0e-ec07-40db-a3b8-218fc0c0a9e2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:10 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09346c6c-b2cd-462f-9bc5-010a3bce6aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6bd63a935d4f9a9178a2858e355849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:08Z,use_quota=True,user_id='5036ee414cd348d09801ee65ad392767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Creating volume 09346c6c-b2cd-462f-9bc5-010a3bce6aa9 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:10 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:10 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 1073741824 Sep 29 12:11:10 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:10 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d Sep 29 12:11:10 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:10 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d" returned: 0 in 0.381s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:10 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d Sep 29 12:11:10 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:11 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 1073741824" returned: 0 in 0.458s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:11 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 Sep 29 12:11:11 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:11 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-55713b50-5777-4740-b672-d8dee8a8c65d" returned: 0 in 0.278s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-quobyte-55713b50-5777-4740-b672-d8dee8a8c65d" released by "delete_volume" :: held 0.710s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Created reservations ['a71fe50b-c24e-4ad3-89a0-f78c521c03e9', 'c4a6b152-93d4-430d-8e9f-a2d6e94e90a2', 'e5df0541-f192-4173-945e-c4df709ed5d5', '2683f476-51fe-454e-badb-bf5587fe87cf'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:11 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:11 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:11 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9" returned: 0 in 0.266s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Attempting download of cceca99f-99b0-40f3-9848-780af1ce7961 ((None, [{'url': 'file:///opt/stack/data/glance/images/cceca99f-99b0-40f3-9848-780af1ce7961', 'metadata': {}}])) to volume 09346c6c-b2cd-462f-9bc5-010a3bce6aa9. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcf23d7-6448-437f-86ef-932ce346dadb]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceca99f-99b0-40f3-9848-780af1ce7961_dsnomlv2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:11 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceca99f-99b0-40f3-9848-780af1ce7961_dsnomlv2 Sep 29 12:11:11 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:11 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.285s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Deleted volume successfully. Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0ed9883f-8384-4bf0-8cf3-5e7340d86a89 tempest-TestServerVolumeAttachmentScenario-250069272 None] Lock "cinder-55713b50-5777-4740-b672-d8dee8a8c65d-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:11 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceca99f-99b0-40f3-9848-780af1ce7961_dsnomlv2" returned: 0 in 0.364s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceca99f-99b0-40f3-9848-780af1ce7961_dsnomlv2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:11 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceca99f-99b0-40f3-9848-780af1ce7961_dsnomlv2 Sep 29 12:11:11 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:12 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:12 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:12 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceca99f-99b0-40f3-9848-780af1ce7961_dsnomlv2" returned: 1 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceca99f-99b0-40f3-9848-780af1ce7961_dsnomlv2' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a807892-b546-4c6f-93a6-957fca597648]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:12 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD Sep 29 12:11:12 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:12 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.294s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:11:12 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:12 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD Sep 29 12:11:12 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:12 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] cceca99f-99b0-40f3-9848-780af1ce7961 was raw, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:11:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:12 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 Sep 29 12:11:12 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:13 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9" returned: 0 in 0.490s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cceca99f-99b0-40f3-9848-780af1ce7961_u92ncqpudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:11:13 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:13 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 1G Sep 29 12:11:13 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:13 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 1G" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Downloaded image cceca99f-99b0-40f3-9848-780af1ce7961 ((None, [{'url': 'file:///opt/stack/data/glance/images/cceca99f-99b0-40f3-9848-780af1ce7961', 'metadata': {}}])) to volume 09346c6c-b2cd-462f-9bc5-010a3bce6aa9 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Temporary image cceca99f-99b0-40f3-9848-780af1ce7961 for user 5036ee414cd348d09801ee65ad392767 is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Marking volume 09346c6c-b2cd-462f-9bc5-010a3bce6aa9 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=203,cinder:SELECT=135,cinder:INSERT=44,cinder:DELETE=15 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Copying metadata from image cceca99f-99b0-40f3-9848-780af1ce7961 to 09346c6c-b2cd-462f-9bc5-010a3bce6aa9. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Creating volume glance metadata for volume 09346c6c-b2cd-462f-9bc5-010a3bce6aa9 backed by image cceca99f-99b0-40f3-9848-780af1ce7961 with: {'image_id': 'cceca99f-99b0-40f3-9848-780af1ce7961', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'af454745a7efe3c328f1b55f705704fb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=152,cinder:UPDATE=201,cinder:INSERT=47,cinder:DELETE=20 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de0b45e-061c-4f12-80fe-70e9158545ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9', 'volume_size': 1, 'image_id': 'cceca99f-99b0-40f3-9848-780af1ce7961', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceca99f-99b0-40f3-9848-780af1ce7961', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af454745a7efe3c328f1b55f705704fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b6bd63a935d4f9a9178a2858e355849', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '481ca643ab0ffb3e13ed9a8ed7cf4f00285f8b91a0a3c1e743c25f57edb42ba3706bd94743f54b00617e6a1dfb71d3a3b442460aa98188993a4100c90abc4e06', 'id': 'cceca99f-99b0-40f3-9848-780af1ce7961', 'created_at': datetime.datetime(2026, 9, 29, 10, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceca99f-99b0-40f3-9848-780af1ce7961/file', 'properties': {}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8ad57e-ec78-4f91-ab15-aff41490276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Volume volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 (09346c6c-b2cd-462f-9bc5-010a3bce6aa9): created successfully Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8ad57e-ec78-4f91-ab15-aff41490276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Flow 'volume_create_manager' (b4a6355f-058b-417e-8853-8a260778ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7011a985-fac0-47ed-b6f1-cc8c92fc17dd tempest-VolumeImageDependencyTests-1393747211 None] Created volume successfully. Sep 29 12:11:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Acquiring lock "cinder-09346c6c-b2cd-462f-9bc5-010a3bce6aa9-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Lock "cinder-09346c6c-b2cd-462f-9bc5-010a3bce6aa9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Acquiring lock "cinder-quobyte-09346c6c-b2cd-462f-9bc5-010a3bce6aa9" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:14 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Lock "cinder-quobyte-09346c6c-b2cd-462f-9bc5-010a3bce6aa9" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:14 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be907c-fe31-4212-8eec-6ca6df8d4752]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:15 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 Sep 29 12:11:15 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:15 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9" returned: 0 in 0.418s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:15 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9 Sep 29 12:11:15 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:15 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-09346c6c-b2cd-462f-9bc5-010a3bce6aa9" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Lock "cinder-quobyte-09346c6c-b2cd-462f-9bc5-010a3bce6aa9" released by "delete_volume" :: held 0.705s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Created reservations ['68e4787b-c049-47c8-a9a6-691efa48992d', 'c77631e5-ff6f-4d04-b127-cefcede4c270', 'ba993aa7-ac7b-4981-a271-124701a4c409', '11ea8c28-9f0e-4c47-ae79-d5c7b5e609f2'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:15 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:15 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:16 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.311s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:16 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Deleted volume successfully. Sep 29 12:11:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cf0e0b6a-e9b9-42d6-90b4-516b2657e4b8 tempest-VolumeImageDependencyTests-1393747211 None] Lock "cinder-09346c6c-b2cd-462f-9bc5-010a3bce6aa9-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Flow 'volume_create_manager' (84aa5ce7-fc76-4043-89a8-20d00c9338cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3187a84a-7d98-4a5a-a487-46f3dd79d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3187a84a-7d98-4a5a-a487-46f3dd79d75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f714939d8044675969558567779c551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:19Z,use_quota=True,user_id='ee22b7e602c343dbab30e16aa71ae5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87310f5-b35b-4d71-87f5-1cc886e656e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87310f5-b35b-4d71-87f5-1cc886e656e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6a9215-b825-4c20-9fb0-c499a7f1895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6a9215-b825-4c20-9fb0-c499a7f1895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33', 'volume_name': 'volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af9a983-2303-4c8e-8475-e263a9f04686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af9a983-2303-4c8e-8475-e263a9f04686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17c1077-4a24-44cc-bbbe-4111a709ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Volume 783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33', 'volume_size': 1} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f714939d8044675969558567779c551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:19Z,use_quota=True,user_id='ee22b7e602c343dbab30e16aa71ae5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Creating volume 783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:19 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:19 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 1073741824 Sep 29 12:11:19 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:19 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 1073741824" returned: 0 in 0.574s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:19 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 Sep 29 12:11:19 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:20 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33" returned: 0 in 0.271s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17c1077-4a24-44cc-bbbe-4111a709ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59968ac5-65bf-461a-8b4b-00178bce009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Volume volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 (783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33): created successfully Sep 29 12:11:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59968ac5-65bf-461a-8b4b-00178bce009c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Flow 'volume_create_manager' (84aa5ce7-fc76-4043-89a8-20d00c9338cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ef0956e0-b94d-450a-81c4-da43b058d997 tempest-CinderUnicodeTest-388497497 None] Created volume successfully. Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Flow 'volume_create_manager' (ef5776a7-620f-4513-aa20-a908a67cbc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea232791-4e21-482c-84c3-8b5932512ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea232791-4e21-482c-84c3-8b5932512ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1359385157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8f8907-214c-4c5a-a772-266456e5ea57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f714939d8044675969558567779c551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:22Z,use_quota=True,user_id='ee22b7e602c343dbab30e16aa71ae5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bae2410-a7f0-4672-9621-96a501515ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bae2410-a7f0-4672-9621-96a501515ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be34a173-6844-4660-ba1b-258c5324d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be34a173-6844-4660-ba1b-258c5324d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8f8907-214c-4c5a-a772-266456e5ea57', 'volume_name': 'volume-fc8f8907-214c-4c5a-a772-266456e5ea57', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b3e9a9-048e-409f-bb65-54a280709732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b3e9a9-048e-409f-bb65-54a280709732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccfdef2-8009-4f10-b720-a856af430cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:21 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Volume fc8f8907-214c-4c5a-a772-266456e5ea57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8f8907-214c-4c5a-a772-266456e5ea57', 'volume_size': 1} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1359385157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8f8907-214c-4c5a-a772-266456e5ea57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f714939d8044675969558567779c551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:22Z,use_quota=True,user_id='ee22b7e602c343dbab30e16aa71ae5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Creating volume fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:21 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:21 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 1073741824 Sep 29 12:11:21 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:22 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 1073741824" returned: 0 in 0.444s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:22 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 Sep 29 12:11:22 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:22 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccfdef2-8009-4f10-b720-a856af430cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8f8907-214c-4c5a-a772-266456e5ea57', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca29bb6-dfc5-46e3-926a-470d4df5c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Volume volume-fc8f8907-214c-4c5a-a772-266456e5ea57 (fc8f8907-214c-4c5a-a772-266456e5ea57): created successfully Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca29bb6-dfc5-46e3-926a-470d4df5c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Flow 'volume_create_manager' (ef5776a7-620f-4513-aa20-a908a67cbc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f29928a9-7c6b-40d8-a953-6c5b0d50c0ce tempest-CinderUnicodeTest-388497497 None] Created volume successfully. Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (061ee75d-d49b-4dd2-9399-f7120e0b7ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbff2d0-01b4-4812-a8a4-2afabf7ec8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbff2d0-01b4-4812-a8a4-2afabf7ec8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336888782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4daeb9-dbfe-4978-9064-e7543d49f926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:24Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb87972b-0277-4cee-966b-080f6ddeaa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb87972b-0277-4cee-966b-080f6ddeaa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb817bb1-f7d4-4d4f-96a5-142678e57ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb817bb1-f7d4-4d4f-96a5-142678e57ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4daeb9-dbfe-4978-9064-e7543d49f926', 'volume_name': 'volume-9a4daeb9-dbfe-4978-9064-e7543d49f926', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505867b1-de69-4225-a208-ad33a267b024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505867b1-de69-4225-a208-ad33a267b024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f6d48e-9c7f-4913-a5b1-03046fe423ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:23 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume 9a4daeb9-dbfe-4978-9064-e7543d49f926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4daeb9-dbfe-4978-9064-e7543d49f926', 'volume_size': 1} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336888782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4daeb9-dbfe-4978-9064-e7543d49f926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:24Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Creating volume 9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:23 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:24 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 1073741824 Sep 29 12:11:24 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:24 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 1073741824" returned: 0 in 0.430s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:24 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 Sep 29 12:11:24 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:24 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926" returned: 0 in 0.235s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.562s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f6d48e-9c7f-4913-a5b1-03046fe423ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4daeb9-dbfe-4978-9064-e7543d49f926', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56de9d7-b3e1-4b3f-9ecf-0c2e15823c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Creating offline snapshot e40ad42d-e415-454f-b489-f537431febe9 of volume fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:11:24 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 (9a4daeb9-dbfe-4978-9064-e7543d49f926): created successfully Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56de9d7-b3e1-4b3f-9ecf-0c2e15823c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (061ee75d-d49b-4dd2-9399-f7120e0b7ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff9329-3cb2-42ca-806f-54d7f8818bba]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:24 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b2df71c5-da05-4bba-8451-90a0a45e40f0 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created volume successfully. Sep 29 12:11:24 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 Sep 29 12:11:24 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:25 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57" returned: 0 in 0.419s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:25 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 1G Sep 29 12:11:25 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:25 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 1G" returned: 0 in 0.383s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8f8907-214c-4c5a-a772-266456e5ea57 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:25 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8f8907-214c-4c5a-a772-266456e5ea57 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 Sep 29 12:11:25 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:25 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8f8907-214c-4c5a-a772-266456e5ea57 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9" returned: 0 in 0.280s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:25 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 is being set with open permissions: ugo+rw Sep 29 12:11:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:25 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 Sep 29 12:11:25 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:26 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:26 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.info Sep 29 12:11:26 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:26 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.info" returned: 0 in 0.244s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:26 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.info is being set with open permissions: ugo+rw Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:26 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.info Sep 29 12:11:26 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:26 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.info" returned: 0 in 0.226s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.474s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Creating offline snapshot 7bb8a223-6ed2-43fa-bd0d-7261854937d1 of volume 9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:11:26 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-26c34dc9-1571-4fc7-ad74-e773d1526e1a tempest-CinderUnicodeTest-388497497 None] Create snapshot completed successfully Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[12093298-1e4c-4b37-899e-3c7f388ab680]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:26 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 Sep 29 12:11:26 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:27 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926" returned: 0 in 0.382s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:27 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 1G Sep 29 12:11:27 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Acquiring lock "cinder-e40ad42d-e415-454f-b489-f537431febe9-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Lock "cinder-e40ad42d-e415-454f-b489-f537431febe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Acquiring lock "cinder-quobyte-fc8f8907-214c-4c5a-a772-266456e5ea57" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-fc8f8907-214c-4c5a-a772-266456e5ea57" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Acquiring lock "cinder-quobyte-e40ad42d-e415-454f-b489-f537431febe9" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-e40ad42d-e415-454f-b489-f537431febe9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Deleting offline snapshot e40ad42d-e415-454f-b489-f537431febe9 of volume fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] snapshot_file for this snap is: volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3d7e1f-000b-4e62-a4bf-a85579cad95f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:27 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 1G" returned: 0 in 0.448s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:27 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 Sep 29 12:11:27 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:27 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 Sep 29 12:11:27 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:27 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc8f8907-214c-4c5a-a772-266456e5ea57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a39731a-6570-4ebd-a40a-6a435cc9cea9]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:27 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1" returned: 0 in 0.315s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:27 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 is being set with open permissions: ugo+rw Sep 29 12:11:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:27 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 Sep 29 12:11:27 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:27 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 Sep 29 12:11:27 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:28 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1" returned: 0 in 0.248s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:28 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.info Sep 29 12:11:28 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:28 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57" returned: 0 in 0.389s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:28 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 Sep 29 12:11:28 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:28 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.info" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:28 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.info is being set with open permissions: ugo+rw Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:28 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.info Sep 29 12:11:28 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:28 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9" returned: 0 in 0.342s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:28 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9 Sep 29 12:11:28 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:28 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.info" returned: 0 in 0.248s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1cc5883b-0a87-4fee-891f-3dec83992515 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Create snapshot completed successfully Sep 29 12:11:28 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57.e40ad42d-e415-454f-b489-f537431febe9" returned: 0 in 0.254s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-e40ad42d-e415-454f-b489-f537431febe9" released by "_delete_snapshot" :: held 1.469s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-fc8f8907-214c-4c5a-a772-266456e5ea57" released by "delete_snapshot" :: held 1.492s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Created reservations ['85134339-abac-4252-80de-79c6f0a6a574', 'ef907ff5-93a8-430b-bea2-7ab2718805a9', 'cb6e8d13-db29-4b35-873e-5de065d0b662', 'b26ea03d-90d0-4a71-a407-6d7d0bd79842'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Delete snapshot completed successfully. Sep 29 12:11:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1e91eb8d-7a6d-425d-8419-1658255b8b6b tempest-CinderUnicodeTest-388497497 None] Lock "cinder-e40ad42d-e415-454f-b489-f537431febe9-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "cinder-fc8f8907-214c-4c5a-a772-266456e5ea57-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-fc8f8907-214c-4c5a-a772-266456e5ea57-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "cinder-quobyte-fc8f8907-214c-4c5a-a772-266456e5ea57" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-fc8f8907-214c-4c5a-a772-266456e5ea57" acquired by "delete_volume" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab29e350-6e19-4fc0-beb9-c1dd2edc4526]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:29 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 Sep 29 12:11:29 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (52a4f4ad-aba3-468f-b7d9-917ac8871ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5541a048-5eeb-46b3-9ce7-482dec2b912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5541a048-5eeb-46b3-9ce7-482dec2b912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127525797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:30Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e17aa9-1b5c-440b-ad84-46b736f96934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e17aa9-1b5c-440b-ad84-46b736f96934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af5792d-ef3a-477a-a343-2d6a7894802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af5792d-ef3a-477a-a343-2d6a7894802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e', 'volume_name': 'volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08238443-2ce6-49a4-8c36-55b15370e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08238443-2ce6-49a4-8c36-55b15370e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38dd402-8dd3-489c-8e5e-7f0da4feae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:29 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e', 'volume_size': 1} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127525797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:30Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Creating volume bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:29 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:29 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e 1073741824 Sep 29 12:11:29 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:30 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57" returned: 0 in 0.423s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:30 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57 Sep 29 12:11:30 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (47e1cbc7-8f81-4d9e-967c-5b6385661e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edadd44-e0f4-42d2-a6e2-a555ba6a6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edadd44-e0f4-42d2-a6e2-a555ba6a6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545804355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de667a10-51cb-4f54-b292-9e8199a6f8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:30Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b2b10f-b9ef-4226-a2d2-aeb633a9bda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b2b10f-b9ef-4226-a2d2-aeb633a9bda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5fe35b-f4df-4e45-a74f-53b372af6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5fe35b-f4df-4e45-a74f-53b372af6192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de667a10-51cb-4f54-b292-9e8199a6f8b2', 'volume_name': 'volume-de667a10-51cb-4f54-b292-9e8199a6f8b2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9233dba8-f55f-46f6-9cd3-c37f323b07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9233dba8-f55f-46f6-9cd3-c37f323b07b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df0e4d5-a601-4f14-bff3-e4fd2e43205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume de667a10-51cb-4f54-b292-9e8199a6f8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de667a10-51cb-4f54-b292-9e8199a6f8b2', 'volume_size': 1} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:30 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc8f8907-214c-4c5a-a772-266456e5ea57" returned: 0 in 0.330s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-fc8f8907-214c-4c5a-a772-266456e5ea57" released by "delete_volume" :: held 0.838s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Created reservations ['6e5e0c6a-74a2-45d3-827e-9a96cbee311e', '4dd80fd4-a9f8-4839-ac35-1d31b180e10e', '54c81617-d37e-4adf-970a-9955d23ae6bc', '26ee4342-5eac-4a79-aadd-b710214c8cba'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:30 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e 1073741824" returned: 0 in 0.628s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:30 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:30 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (2f4e7eff-1d6a-41a4-ab60-2b5155cb071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4702d52b-cc73-40fc-b600-d3d53fad31f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:30 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e Sep 29 12:11:30 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4702d52b-cc73-40fc-b600-d3d53fad31f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2081047697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7a038f-d954-4bdc-9dd1-e0b75f8efadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:30Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ee107a-c742-4c3c-96fc-381e6a0491a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ee107a-c742-4c3c-96fc-381e6a0491a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e96a820-776d-4959-a9a1-3ff55058176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e96a820-776d-4959-a9a1-3ff55058176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7a038f-d954-4bdc-9dd1-e0b75f8efadf', 'volume_name': 'volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c63761b-435f-4e50-a87c-b008fa7f075f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c63761b-435f-4e50-a87c-b008fa7f075f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5504510f-50a8-4883-834a-f0ffc78a785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume ff7a038f-d954-4bdc-9dd1-e0b75f8efadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf', 'volume_size': 1} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "cinder-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "cinder-quobyte-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:30 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.467s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:30 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:30 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Deleted volume successfully. Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e" returned: 0 in 0.359s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545804355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de667a10-51cb-4f54-b292-9e8199a6f8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:30Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Creating volume de667a10-51cb-4f54-b292-9e8199a6f8b2 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:31 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc04be-1385-4524-8de8-7cf16e33216b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:31 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 1073741824 Sep 29 12:11:31 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38dd402-8dd3-489c-8e5e-7f0da4feae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0771dee-7a91-43df-92d9-0eeb4679a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-39cf7e90-0b25-4eb1-8851-3244a345e386 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-fc8f8907-214c-4c5a-a772-266456e5ea57-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e (bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e): created successfully Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0771dee-7a91-43df-92d9-0eeb4679a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (52a4f4ad-aba3-468f-b7d9-917ac8871ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8af7cd47-c703-43b7-aa50-6795ef8d7615 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created volume successfully. Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (f5d7efed-67d0-407c-b1ea-409d65acb8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646ec9c8-2326-47b4-97bd-e95ef74d74cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 Sep 29 12:11:31 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646ec9c8-2326-47b4-97bd-e95ef74d74cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482362150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cc201a-079e-49fb-bb28-d9161057c031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:31Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adf8d30-aec1-4f28-88bc-a66c19c8f8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adf8d30-aec1-4f28-88bc-a66c19c8f8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc141b6-1ee5-439c-abda-5011783c5b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc141b6-1ee5-439c-abda-5011783c5b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1cc201a-079e-49fb-bb28-d9161057c031', 'volume_name': 'volume-e1cc201a-079e-49fb-bb28-d9161057c031', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523ae614-e3d4-4326-951c-499e542229ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523ae614-e3d4-4326-951c-499e542229ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368e9bdd-d400-4cb0-837d-5ab0f10a981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume e1cc201a-079e-49fb-bb28-d9161057c031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1cc201a-079e-49fb-bb28-d9161057c031', 'volume_size': 1} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:31 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33" returned: 0 in 0.467s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:31 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33 Sep 29 12:11:31 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (fa38c319-d41a-45e2-bfed-c707663da750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9104d082-24c1-4c97-9bb7-1497af16b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9104d082-24c1-4c97-9bb7-1497af16b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42731854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f6ff72-cd15-4c0d-b61e-a6db3243d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:31Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0dec47-8eff-4892-aade-094f0dffffa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0dec47-8eff-4892-aade-094f0dffffa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa235b3-d1df-40c3-b9ca-6cc4c01a95f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa235b3-d1df-40c3-b9ca-6cc4c01a95f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f6ff72-cd15-4c0d-b61e-a6db3243d47e', 'volume_name': 'volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcb01a-ce99-431d-a481-68ff7111fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcb01a-ce99-431d-a481-68ff7111fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bcc974-2543-422e-a83d-9433042843ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume 24f6ff72-cd15-4c0d-b61e-a6db3243d47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e', 'volume_size': 1} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:31 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 1073741824" returned: 0 in 0.616s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:31 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 Sep 29 12:11:31 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:31 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33" returned: 0 in 0.276s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-quobyte-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33" released by "delete_volume" :: held 0.837s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Created reservations ['6c3734ae-a48c-47af-b49b-e00ebee528ac', '30cff0fd-a70a-4994-b08a-abf595683da0', 'f5d6e242-c2f5-4a7f-b539-fb1419a2a9b8', 'a4325492-7888-4cd3-a910-4a955192b18a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:31 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2" returned: 0 in 0.277s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2081047697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7a038f-d954-4bdc-9dd1-e0b75f8efadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:30Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Creating volume ff7a038f-d954-4bdc-9dd1-e0b75f8efadf {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:31 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:31 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:31 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df0e4d5-a601-4f14-bff3-e4fd2e43205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de667a10-51cb-4f54-b292-9e8199a6f8b2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf 1073741824 Sep 29 12:11:31 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92497b8-e039-462d-8d33-de51fbe8ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 (de667a10-51cb-4f54-b292-9e8199a6f8b2): created successfully Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92497b8-e039-462d-8d33-de51fbe8ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (47e1cbc7-8f81-4d9e-967c-5b6385661e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e0b58054-8f3c-4389-8abf-bd009aeebbc8 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created volume successfully. Sep 29 12:11:32 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.243s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Deleted volume successfully. Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2ec1cfe5-24cd-4ac9-8463-b941cab7cc04 tempest-CinderUnicodeTest-388497497 None] Lock "cinder-783db4d6-c4c3-4bf1-bd0a-ee1fe899ce33-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:32 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf 1073741824" returned: 0 in 0.438s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:32 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf Sep 29 12:11:32 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:32 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482362150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cc201a-079e-49fb-bb28-d9161057c031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:31Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Creating volume e1cc201a-079e-49fb-bb28-d9161057c031 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:32 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:32 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 1073741824 Sep 29 12:11:32 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5504510f-50a8-4883-834a-f0ffc78a785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcd98de-55de-414c-a6f1-e4c46ae3e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:32 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf (ff7a038f-d954-4bdc-9dd1-e0b75f8efadf): created successfully Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcd98de-55de-414c-a6f1-e4c46ae3e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (2f4e7eff-1d6a-41a4-ab60-2b5155cb071f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2d1b7efa-0718-4eb4-b9e6-e93879ffa661 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created volume successfully. Sep 29 12:11:33 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 1073741824" returned: 0 in 0.433s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:33 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 Sep 29 12:11:33 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:33 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031" returned: 0 in 0.263s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42731854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f6ff72-cd15-4c0d-b61e-a6db3243d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390c7d2302f4ff485e490949e0c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:31Z,use_quota=True,user_id='35a939d161834893b2f5d24bc2953d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Creating volume 24f6ff72-cd15-4c0d-b61e-a6db3243d47e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:33 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368e9bdd-d400-4cb0-837d-5ab0f10a981d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1cc201a-079e-49fb-bb28-d9161057c031', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0b241-03c9-457e-9e56-6fdc3acddede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:33 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e 1073741824 Sep 29 12:11:33 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:33 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume volume-e1cc201a-079e-49fb-bb28-d9161057c031 (e1cc201a-079e-49fb-bb28-d9161057c031): created successfully Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0b241-03c9-457e-9e56-6fdc3acddede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (f5d7efed-67d0-407c-b1ea-409d65acb8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cfec44c8-f4fe-4445-a1c7-d441a8281623 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created volume successfully. Sep 29 12:11:33 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e 1073741824" returned: 0 in 0.484s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:33 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e Sep 29 12:11:33 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:34 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e" returned: 0 in 0.253s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bcc974-2543-422e-a83d-9433042843ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab0ec01-b301-4d65-84e8-fa8ed0a7c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:34 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Volume volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e (24f6ff72-cd15-4c0d-b61e-a6db3243d47e): created successfully Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab0ec01-b301-4d65-84e8-fa8ed0a7c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Flow 'volume_create_manager' (fa38c319-d41a-45e2-bfed-c707663da750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-619a28e3-2e76-4667-88ce-fc36d2b9a33c tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created volume successfully. Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-24f6ff72-cd15-4c0d-b61e-a6db3243d47e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-24f6ff72-cd15-4c0d-b61e-a6db3243d47e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-24f6ff72-cd15-4c0d-b61e-a6db3243d47e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-24f6ff72-cd15-4c0d-b61e-a6db3243d47e" acquired by "delete_volume" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3eac4-8c87-4575-8827-926f0d87518a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:35 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e Sep 29 12:11:35 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:35 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:35 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e Sep 29 12:11:35 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:35 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-24f6ff72-cd15-4c0d-b61e-a6db3243d47e" returned: 0 in 0.245s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-24f6ff72-cd15-4c0d-b61e-a6db3243d47e" released by "delete_volume" :: held 0.648s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created reservations ['72a22e9a-9725-4a0c-9bab-5a20afdc6f55', 'e987f0ae-6b5e-4ed0-8ada-6fc6fe72ca24', 'e6192965-92a5-4b1d-9350-25d68c8fbe0c', 'f5b162ca-f7ab-4558-b38b-97039e4677a1'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:35 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:35 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:36 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.283s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:36 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Deleted volume successfully. Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c1e2521f-9ed0-45c3-8694-2a530d72938e tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-24f6ff72-cd15-4c0d-b61e-a6db3243d47e-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-e1cc201a-079e-49fb-bb28-d9161057c031-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-e1cc201a-079e-49fb-bb28-d9161057c031-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-e1cc201a-079e-49fb-bb28-d9161057c031" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-e1cc201a-079e-49fb-bb28-d9161057c031" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c8004-47b2-4bf4-b384-9de6f2f94e3b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:36 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 Sep 29 12:11:36 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:36 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:36 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031 Sep 29 12:11:36 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:36 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1cc201a-079e-49fb-bb28-d9161057c031" returned: 0 in 0.276s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-e1cc201a-079e-49fb-bb28-d9161057c031" released by "delete_volume" :: held 0.722s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created reservations ['e0816d9e-0c96-437f-969e-186f10f1647c', '6ff5e4bf-4f3b-418d-9817-eba6af57e491', '27372dbe-f51b-498e-999e-a750fb4ed375', '539f5937-8be7-49c5-9dc5-e0465813239c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:37 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:37 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:37 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.289s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:37 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Deleted volume successfully. Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7e6ea73a-2fcc-411b-9ad6-34c041c537c4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-e1cc201a-079e-49fb-bb28-d9161057c031-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d752e4-992c-4ca8-827e-23e375dda4b3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:37 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf Sep 29 12:11:37 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:37 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf" returned: 0 in 0.387s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:37 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf Sep 29 12:11:37 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:38 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf" released by "delete_volume" :: held 0.692s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created reservations ['3f3bc3ab-ce91-40c6-bbfc-0a4b1a760fb1', 'b275b044-c44c-43f5-bc5d-9c092ab02b9e', 'e4471e9e-8558-498c-9a4b-1ab236cac14e', '84597471-c2d3-43cc-924a-1bbcd9e6619c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:38 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:38 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-de667a10-51cb-4f54-b292-9e8199a6f8b2-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-de667a10-51cb-4f54-b292-9e8199a6f8b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:38 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.307s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-de667a10-51cb-4f54-b292-9e8199a6f8b2" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:38 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Deleted volume successfully. Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-de667a10-51cb-4f54-b292-9e8199a6f8b2" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c0409f5-8f80-494d-a01e-93c786c50e3f tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-ff7a038f-d954-4bdc-9dd1-e0b75f8efadf-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6d9fb-ddb7-4cff-b0a4-f6d65637bff0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:38 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 Sep 29 12:11:38 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:38 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2" returned: 0 in 0.395s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:38 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2 Sep 29 12:11:38 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:39 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-de667a10-51cb-4f54-b292-9e8199a6f8b2" returned: 0 in 0.264s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-de667a10-51cb-4f54-b292-9e8199a6f8b2" released by "delete_volume" :: held 0.712s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created reservations ['765ead1c-db26-44fe-9039-7a0bfb37fcfb', 'b000e98d-baa5-4a92-ade7-e367aaf472a8', '88009b6a-3b1d-4331-b83f-0039d258bbc0', 'a7fe9677-266d-4df1-8fb9-dccfad54b941'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:39 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:39 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:39 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.253s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Deleted volume successfully. Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4ac2bc84-dfd1-4018-96f6-82f5bf102082 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-de667a10-51cb-4f54-b292-9e8199a6f8b2-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bcf527-ac99-4061-8022-2ebf9c467ff0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:39 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e Sep 29 12:11:39 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:40 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e" returned: 0 in 0.390s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:40 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e Sep 29 12:11:40 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:40 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e" released by "delete_volume" :: held 0.719s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created reservations ['6b41491d-3085-42ea-8680-025c20ab5e79', 'e5fe6c9e-a967-43a9-92e0-8436d3261946', '34f74368-52d8-4e03-a20a-3bdc86fc03fc', 'f357f939-afe3-4758-a080-ddf0ac254c83'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:40 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:40 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-7bb8a223-6ed2-43fa-bd0d-7261854937d1-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:40 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-7bb8a223-6ed2-43fa-bd0d-7261854937d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-9a4daeb9-dbfe-4978-9064-e7543d49f926" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.296s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Deleted volume successfully. Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-9a4daeb9-dbfe-4978-9064-e7543d49f926" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-7bb8a223-6ed2-43fa-bd0d-7261854937d1" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4d33e7e7-857a-40f6-bd56-b456f3ad69a4 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-bf1d8439-1ea5-4b44-a16f-fbc0cb2b672e-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-7bb8a223-6ed2-43fa-bd0d-7261854937d1" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Deleting offline snapshot 7bb8a223-6ed2-43fa-bd0d-7261854937d1 of volume 9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] snapshot_file for this snap is: volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef2dc95-c81a-45b6-8b40-08b5a1f5e7eb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:41 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 Sep 29 12:11:41 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:41 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1" returned: 0 in 0.404s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a4daeb9-dbfe-4978-9064-e7543d49f926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:11:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[657baffe-9d27-4488-86f5-9c4695e5a564]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:41 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 Sep 29 12:11:41 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:41 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926" returned: 0 in 0.390s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:41 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 Sep 29 12:11:41 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:42 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1" returned: 0 in 0.355s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:42 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1 Sep 29 12:11:42 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:42 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926.7bb8a223-6ed2-43fa-bd0d-7261854937d1" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-7bb8a223-6ed2-43fa-bd0d-7261854937d1" released by "_delete_snapshot" :: held 1.530s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-9a4daeb9-dbfe-4978-9064-e7543d49f926" released by "delete_snapshot" :: held 1.580s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created reservations ['6c590d0d-05a1-46a0-89c1-2fe888f82cbd', '7a19a67d-fc2b-4e8c-b5af-70cbe44ff089', '235325a1-d668-480d-af04-a7c994b9ba56', '2977c821-3050-4e82-a593-b8542e200c66'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Delete snapshot completed successfully. Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ce8b45ef-6ca9-456e-afeb-9e075fcc152d tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-7bb8a223-6ed2-43fa-bd0d-7261854937d1-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-9a4daeb9-dbfe-4978-9064-e7543d49f926-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-9a4daeb9-dbfe-4978-9064-e7543d49f926-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "cinder-quobyte-9a4daeb9-dbfe-4978-9064-e7543d49f926" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-9a4daeb9-dbfe-4978-9064-e7543d49f926" acquired by "delete_volume" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5504f6-7046-44d3-a5bd-0f04e08773c4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:43 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 Sep 29 12:11:43 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:43 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926" returned: 0 in 0.388s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:43 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926 Sep 29 12:11:43 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:43 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a4daeb9-dbfe-4978-9064-e7543d49f926" returned: 0 in 0.256s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-quobyte-9a4daeb9-dbfe-4978-9064-e7543d49f926" released by "delete_volume" :: held 0.720s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Created reservations ['a7963422-c61c-4968-8bb2-c5fa9c807f70', '73f6202e-d3d0-40d5-9630-bc29f4684896', 'cd8aa6f8-b8f4-4739-b887-fb1344de8d76', '415c8604-381b-4bb2-ae48-fac152277de1'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:43 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:11:43 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:44 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:44 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:11:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Deleted volume successfully. Sep 29 12:11:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-716479f7-6d16-4e93-b4b4-838749021177 tempest-CreateVolumesFromSnapshotTest-1138462972 None] Lock "cinder-9a4daeb9-dbfe-4978-9064-e7543d49f926-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Flow 'volume_create_manager' (6b86373b-af0a-4bb6-93fc-f70bbca85abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f687f4-6444-49c6-8e9e-a633ef8970c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f687f4-6444-49c6-8e9e-a633ef8970c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-179038942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fabd3a6-7862-452c-91d8-cdde15f20428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93df8c6629014be98b85cd4e7eb12646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:48Z,use_quota=True,user_id='c41e69cc6356470dbdfdd322ba7d20ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199afde1-aec2-4d32-8ec1-04ed8f88d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199afde1-aec2-4d32-8ec1-04ed8f88d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a6309-b01c-4b1c-b275-d26395385b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a6309-b01c-4b1c-b275-d26395385b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fabd3a6-7862-452c-91d8-cdde15f20428', 'volume_name': 'volume-3fabd3a6-7862-452c-91d8-cdde15f20428', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e6f977-5d34-419b-a047-303a84b401a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e6f977-5d34-419b-a047-303a84b401a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d88c78-d117-4297-8d56-ba565fa36d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:48 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Volume 3fabd3a6-7862-452c-91d8-cdde15f20428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fabd3a6-7862-452c-91d8-cdde15f20428', 'volume_size': 1} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-179038942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fabd3a6-7862-452c-91d8-cdde15f20428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93df8c6629014be98b85cd4e7eb12646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:48Z,use_quota=True,user_id='c41e69cc6356470dbdfdd322ba7d20ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Creating volume 3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:48 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:48 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 1073741824 Sep 29 12:11:48 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:48 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 1073741824" returned: 0 in 0.577s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:48 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 Sep 29 12:11:48 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:49 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428" returned: 0 in 0.264s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:11:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d88c78-d117-4297-8d56-ba565fa36d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fabd3a6-7862-452c-91d8-cdde15f20428', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea2fcca-0f67-4e5d-8274-87184170393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Volume volume-3fabd3a6-7862-452c-91d8-cdde15f20428 (3fabd3a6-7862-452c-91d8-cdde15f20428): created successfully Sep 29 12:11:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea2fcca-0f67-4e5d-8274-87184170393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Flow 'volume_create_manager' (6b86373b-af0a-4bb6-93fc-f70bbca85abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e0034961-b188-4a5f-9d28-0862d260ba13 tempest-VolumeDependencyTests-435196720 None] Created volume successfully. Sep 29 12:11:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Creating offline snapshot b187404d-89e4-4b57-ac3f-dc6a998cda8e of volume 3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:11:50 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7768cb-a5dd-4727-bf8f-4ecea3431214]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:50 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 Sep 29 12:11:50 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:50 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428" returned: 0 in 0.388s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:50 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e 1G Sep 29 12:11:50 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:51 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e 1G" returned: 0 in 0.471s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fabd3a6-7862-452c-91d8-cdde15f20428 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:51 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fabd3a6-7862-452c-91d8-cdde15f20428 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e Sep 29 12:11:51 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:51 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fabd3a6-7862-452c-91d8-cdde15f20428 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e" returned: 0 in 0.305s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:51 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e is being set with open permissions: ugo+rw Sep 29 12:11:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:51 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e Sep 29 12:11:51 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:51 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e" returned: 0 in 0.249s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:52 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.info Sep 29 12:11:52 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:52 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.info" returned: 0 in 0.255s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:52 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.info is being set with open permissions: ugo+rw Sep 29 12:11:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:52 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.info Sep 29 12:11:52 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:52 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.info" returned: 0 in 0.240s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:52 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-860dc6a1-6e60-40e7-b1ea-cb0dfe3004b4 tempest-VolumeDependencyTests-435196720 None] Create snapshot completed successfully Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Flow 'volume_create_manager' (6353012c-4dc2-4620-a0f7-2bc53ba4be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0255c247-3ad3-4931-a1b5-f304444a7f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0255c247-3ad3-4931-a1b5-f304444a7f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-122791360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828baf35-c560-4413-bf1c-cf4859e0b869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93df8c6629014be98b85cd4e7eb12646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b187404d-89e4-4b57-ac3f-dc6a998cda8e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:11:54Z,use_quota=True,user_id='c41e69cc6356470dbdfdd322ba7d20ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced1c226-d0ae-42fe-aaca-ae85acba0ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced1c226-d0ae-42fe-aaca-ae85acba0ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f275db29-82f0-431b-a71a-006dc6a77040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f275db29-82f0-431b-a71a-006dc6a77040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '828baf35-c560-4413-bf1c-cf4859e0b869', 'volume_name': 'volume-828baf35-c560-4413-bf1c-cf4859e0b869', 'volume_size': 1, 'snapshot_id': 'b187404d-89e4-4b57-ac3f-dc6a998cda8e'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1ef245-b7c4-4b53-86ad-004cb363d89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1ef245-b7c4-4b53-86ad-004cb363d89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4d02a9-3a68-4771-8e6a-a8d36fd85b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:11:54 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Volume 828baf35-c560-4413-bf1c-cf4859e0b869: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-828baf35-c560-4413-bf1c-cf4859e0b869', 'volume_size': 1, 'snapshot_id': 'b187404d-89e4-4b57-ac3f-dc6a998cda8e'} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-quobyte-b187404d-89e4-4b57-ac3f-dc6a998cda8e-828baf35-c560-4413-bf1c-cf4859e0b869" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-b187404d-89e4-4b57-ac3f-dc6a998cda8e-828baf35-c560-4413-bf1c-cf4859e0b869" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Creating volume 828baf35-c560-4413-bf1c-cf4859e0b869 from snapshot b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-quobyte-828baf35-c560-4413-bf1c-cf4859e0b869" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-828baf35-c560-4413-bf1c-cf4859e0b869" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] snapshot: b187404d-89e4-4b57-ac3f-dc6a998cda8e, volume: 828baf35-c560-4413-bf1c-cf4859e0b869, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b373f9ab-1cb5-436c-b40c-94a124541202]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:54 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e Sep 29 12:11:54 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:54 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e" returned: 0 in 0.415s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fabd3a6-7862-452c-91d8-cdde15f20428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0b7e58-64ce-4e48-b9a7-28c59ca6ee99]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:11:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:55 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 Sep 29 12:11:55 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:11:55 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 29 12:11:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428" returned: 0 in 0.413s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:11:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:11:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:11:55 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:11:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:11:55 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 Sep 29 12:11:55 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:02 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869" returned: 0 in 7.402s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:02 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:12:02 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Converted 1024.00 MB image at 138.32 MB/s Sep 29 12:12:02 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 is being set with open permissions: ugo+rw Sep 29 12:12:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:02 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 Sep 29 12:12:02 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:03 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-828baf35-c560-4413-bf1c-cf4859e0b869" released by "_copy_volume_from_snapshot" :: held 8.684s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Flow 'volume_create_manager' (4b1239df-8758-4a7c-bd2c-ef12b4c89688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50df8b9f-ce57-4892-bd8b-114af16d8cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50df8b9f-ce57-4892-bd8b-114af16d8cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-26535358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6619966a-24a3-473e-9489-5aa0bc587ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e084bbc23a134c20bcf57445a512c995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:03Z,use_quota=True,user_id='190d407e2d834832bb47d2fca24641ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb9768a-0c76-482c-9310-f1f98a1a7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb9768a-0c76-482c-9310-f1f98a1a7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14badfae-1b9b-4524-bd3a-bb1f4b4ff391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14badfae-1b9b-4524-bd3a-bb1f4b4ff391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6619966a-24a3-473e-9489-5aa0bc587ecc', 'volume_name': 'volume-6619966a-24a3-473e-9489-5aa0bc587ecc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a8449-1c29-4ff1-9966-701b0958bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a8449-1c29-4ff1-9966-701b0958bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea32930-4cdb-4e79-90cd-2c59491ec76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:03 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Volume 6619966a-24a3-473e-9489-5aa0bc587ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6619966a-24a3-473e-9489-5aa0bc587ecc', 'volume_size': 1} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-b187404d-89e4-4b57-ac3f-dc6a998cda8e-828baf35-c560-4413-bf1c-cf4859e0b869" released by "_create_volume_from_snapshot" :: held 8.827s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.851s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-26535358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6619966a-24a3-473e-9489-5aa0bc587ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e084bbc23a134c20bcf57445a512c995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:03Z,use_quota=True,user_id='190d407e2d834832bb47d2fca24641ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Creating volume 6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:03 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:03 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc 1073741824 Sep 29 12:12:03 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4d02a9-3a68-4771-8e6a-a8d36fd85b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828baf35-c560-4413-bf1c-cf4859e0b869', 'volume_size': 1, 'snapshot_id': 'b187404d-89e4-4b57-ac3f-dc6a998cda8e'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2844737c-5824-405e-bf9f-cc502fc415a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:03 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Volume volume-828baf35-c560-4413-bf1c-cf4859e0b869 (828baf35-c560-4413-bf1c-cf4859e0b869): created successfully Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2844737c-5824-405e-bf9f-cc502fc415a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Flow 'volume_create_manager' (6353012c-4dc2-4620-a0f7-2bc53ba4be09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8c66ccce-767b-452f-8ae3-22f8dd7ebff5 tempest-VolumeDependencyTests-435196720 None] Created volume successfully. Sep 29 12:12:03 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc 1073741824" returned: 0 in 0.406s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:03 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc Sep 29 12:12:03 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:03 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea32930-4cdb-4e79-90cd-2c59491ec76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6619966a-24a3-473e-9489-5aa0bc587ecc', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057fffcb-a5aa-41a5-8361-ba3440006370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:03 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Volume volume-6619966a-24a3-473e-9489-5aa0bc587ecc (6619966a-24a3-473e-9489-5aa0bc587ecc): created successfully Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057fffcb-a5aa-41a5-8361-ba3440006370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Flow 'volume_create_manager' (4b1239df-8758-4a7c-bd2c-ef12b4c89688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0e7eee0f-0c73-42d1-b5c1-b7ba9295e5f9 tempest-SnapshotDependencyTests-2087901085 None] Created volume successfully. Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-b187404d-89e4-4b57-ac3f-dc6a998cda8e-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-b187404d-89e4-4b57-ac3f-dc6a998cda8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-quobyte-3fabd3a6-7862-452c-91d8-cdde15f20428" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-3fabd3a6-7862-452c-91d8-cdde15f20428" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-quobyte-b187404d-89e4-4b57-ac3f-dc6a998cda8e" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-b187404d-89e4-4b57-ac3f-dc6a998cda8e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Deleting offline snapshot b187404d-89e4-4b57-ac3f-dc6a998cda8e of volume 3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] snapshot_file for this snap is: volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275f4fd-c7af-4f20-93ab-b007a4d05881]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:04 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e Sep 29 12:12:04 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Creating offline snapshot 7bd1da3c-313a-4508-af00-4d55ca9d812a of volume 6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2af9d7-1ce9-4361-8bd9-853d565d07f1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:04 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc Sep 29 12:12:04 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:04 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e" returned: 0 in 0.391s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fabd3a6-7862-452c-91d8-cdde15f20428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7b2f49-5e7a-439d-bec7-d56f9dd4811a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:04 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 Sep 29 12:12:04 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:04 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc" returned: 0 in 0.379s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:04 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a 1G Sep 29 12:12:04 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:05 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428" returned: 0 in 0.538s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:05 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e Sep 29 12:12:05 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:05 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a 1G" returned: 0 in 0.478s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6619966a-24a3-473e-9489-5aa0bc587ecc -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:05 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6619966a-24a3-473e-9489-5aa0bc587ecc -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a Sep 29 12:12:05 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:05 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e" returned: 0 in 0.360s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:05 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e Sep 29 12:12:05 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:05 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6619966a-24a3-473e-9489-5aa0bc587ecc -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a" returned: 0 in 0.287s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:05 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a is being set with open permissions: ugo+rw Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:05 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a Sep 29 12:12:05 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:05 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428.b187404d-89e4-4b57-ac3f-dc6a998cda8e" returned: 0 in 0.254s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:05 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a" returned: 0 in 0.257s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-b187404d-89e4-4b57-ac3f-dc6a998cda8e" released by "_delete_snapshot" :: held 1.658s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-3fabd3a6-7862-452c-91d8-cdde15f20428" released by "delete_snapshot" :: held 1.681s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:05 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.info Sep 29 12:12:05 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Created reservations ['84e09016-6a7c-4e67-bc7b-03c0057981cd', 'ef09be90-db72-45be-ae4c-581816ff112c', '952669c7-6400-401c-a014-19ae28368729', '3ccfe071-e01a-42d0-baaa-845649911395'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:05 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Delete snapshot completed successfully. Sep 29 12:12:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4b14b8d-938b-44e2-8a83-caa81b05cd60 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-b187404d-89e4-4b57-ac3f-dc6a998cda8e-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:06 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.info" returned: 0 in 0.253s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:06 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.info is being set with open permissions: ugo+rw Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:06 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.info Sep 29 12:12:06 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-3fabd3a6-7862-452c-91d8-cdde15f20428-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-3fabd3a6-7862-452c-91d8-cdde15f20428-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-quobyte-3fabd3a6-7862-452c-91d8-cdde15f20428" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-3fabd3a6-7862-452c-91d8-cdde15f20428" acquired by "delete_volume" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:06 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.info" returned: 0 in 0.273s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f094b450-fccd-47b3-b328-37a10950b6be]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cf3712f5-f409-4489-b4b3-5d3b09c92a08 tempest-SnapshotDependencyTests-2087901085 None] Create snapshot completed successfully Sep 29 12:12:06 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 Sep 29 12:12:06 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:06 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428" returned: 0 in 0.363s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:06 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428 Sep 29 12:12:06 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:06 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3fabd3a6-7862-452c-91d8-cdde15f20428" returned: 0 in 0.239s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-3fabd3a6-7862-452c-91d8-cdde15f20428" released by "delete_volume" :: held 0.689s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Created reservations ['e76d39a2-3bae-45a5-a83a-693cf2cc7087', 'c911d8bc-f3e7-4429-a2d5-efb45ba372d6', '5fae3f6e-1eab-44a0-9867-6ffbaeeefad4', 'd514dc87-483c-424d-ac04-24213c468a4c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:07 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:07 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:07 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.257s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Deleted volume successfully. Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51df57d2-b8d8-4855-aa28-84a6d1f37d97 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-3fabd3a6-7862-452c-91d8-cdde15f20428-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-828baf35-c560-4413-bf1c-cf4859e0b869-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-828baf35-c560-4413-bf1c-cf4859e0b869-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "cinder-quobyte-828baf35-c560-4413-bf1c-cf4859e0b869" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-828baf35-c560-4413-bf1c-cf4859e0b869" acquired by "delete_volume" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5938f7-a9d8-42cb-a2b0-51354588c2eb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:07 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 Sep 29 12:12:07 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:07 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869" returned: 0 in 0.385s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:07 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869 Sep 29 12:12:07 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Flow 'volume_create_manager' (5ec00878-d841-48cf-a0ff-2e628f00838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfec6b2-c41d-441e-8ed5-26257cff3549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfec6b2-c41d-441e-8ed5-26257cff3549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39fd008-3c77-4b36-aaad-cc3a42723519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e084bbc23a134c20bcf57445a512c995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7bd1da3c-313a-4508-af00-4d55ca9d812a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:08Z,use_quota=True,user_id='190d407e2d834832bb47d2fca24641ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cf6011-086c-4ac0-94e0-139c6082cb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cf6011-086c-4ac0-94e0-139c6082cb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c2a804-de75-4cfc-82ec-21afcad9c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c2a804-de75-4cfc-82ec-21afcad9c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e39fd008-3c77-4b36-aaad-cc3a42723519', 'volume_name': 'volume-e39fd008-3c77-4b36-aaad-cc3a42723519', 'volume_size': 1, 'snapshot_id': '7bd1da3c-313a-4508-af00-4d55ca9d812a'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c9fbd1-6298-4490-b51f-398fda2a01b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:08 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c9fbd1-6298-4490-b51f-398fda2a01b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38766dd-b672-4c63-b1e9-87ec9513feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Volume e39fd008-3c77-4b36-aaad-cc3a42723519: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e39fd008-3c77-4b36-aaad-cc3a42723519', 'volume_size': 1, 'snapshot_id': '7bd1da3c-313a-4508-af00-4d55ca9d812a'} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-828baf35-c560-4413-bf1c-cf4859e0b869" returned: 0 in 0.289s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-quobyte-7bd1da3c-313a-4508-af00-4d55ca9d812a-e39fd008-3c77-4b36-aaad-cc3a42723519" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-quobyte-828baf35-c560-4413-bf1c-cf4859e0b869" released by "delete_volume" :: held 0.722s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-7bd1da3c-313a-4508-af00-4d55ca9d812a-e39fd008-3c77-4b36-aaad-cc3a42723519" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Creating volume e39fd008-3c77-4b36-aaad-cc3a42723519 from snapshot 7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-quobyte-e39fd008-3c77-4b36-aaad-cc3a42723519" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-e39fd008-3c77-4b36-aaad-cc3a42723519" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] snapshot: 7bd1da3c-313a-4508-af00-4d55ca9d812a, volume: e39fd008-3c77-4b36-aaad-cc3a42723519, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c512ac-a003-4ba6-83fc-ca5bdc67d431]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Created reservations ['394109b3-62f7-41bf-a2c1-6bae1d7607d1', '7e306fdc-d34b-4670-a0c4-ea9d2d1ca954', 'cc987305-0f8f-4c2e-b6dd-57820716f606', 'f8108af6-8dad-43f7-a096-9d9e2db37609'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:08 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a Sep 29 12:12:08 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:08 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:08 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:08 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:08 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Deleted volume successfully. Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-61ff24f6-be1e-4a8d-a980-2c23a1687500 tempest-VolumeDependencyTests-435196720 None] Lock "cinder-828baf35-c560-4413-bf1c-cf4859e0b869-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:08 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a" returned: 0 in 0.429s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6619966a-24a3-473e-9489-5aa0bc587ecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[53279e76-d674-4470-a941-83ac2053be2d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:08 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc Sep 29 12:12:08 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:09 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc" returned: 0 in 0.388s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:12:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:12:09 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:12:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:09 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 Sep 29 12:12:09 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:12 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:12 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:12 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.387s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:12:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:INSERT=32,cinder:UPDATE=142,cinder:SELECT=123,cinder:DELETE=14 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=108,cinder:INSERT=47,cinder:UPDATE=150,cinder:DELETE=13 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Flow 'volume_create_manager' (051a4a67-1bfe-48d6-8d51-950f7deb2c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6804ca01-5e13-4e63-8dae-3b79e72e2977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6804ca01-5e13-4e63-8dae-3b79e72e2977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764971912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9bee2f67d24193a00ac2054f1d8b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:14Z,use_quota=True,user_id='17e3dc7be0f24cddbcae509731fedab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212dd488-3c2d-4d92-b15e-f0387e7a1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212dd488-3c2d-4d92-b15e-f0387e7a1347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedb8318-cf60-43b4-ab3a-b159957785ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedb8318-cf60-43b4-ab3a-b159957785ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95', 'volume_name': 'volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfbd87d-b3dc-4493-a81e-5e7779d7f06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfbd87d-b3dc-4493-a81e-5e7779d7f06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da40a7b0-08c4-4a0a-9d6a-0f5bb9ed81de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:14 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Volume 9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95', 'volume_size': 1} Sep 29 12:12:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:16 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519" returned: 0 in 7.077s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:12:16 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Converted 1024.00 MB image at 144.65 MB/s Sep 29 12:12:16 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 is being set with open permissions: ugo+rw Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:16 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 Sep 29 12:12:16 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:16 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519" returned: 0 in 0.257s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-e39fd008-3c77-4b36-aaad-cc3a42723519" released by "_copy_volume_from_snapshot" :: held 8.246s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-7bd1da3c-313a-4508-af00-4d55ca9d812a-e39fd008-3c77-4b36-aaad-cc3a42723519" released by "_create_volume_from_snapshot" :: held 8.307s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.325s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764971912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9bee2f67d24193a00ac2054f1d8b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:14Z,use_quota=True,user_id='17e3dc7be0f24cddbcae509731fedab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Creating volume 9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:16 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:16 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 1073741824 Sep 29 12:12:16 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38766dd-b672-4c63-b1e9-87ec9513feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39fd008-3c77-4b36-aaad-cc3a42723519', 'volume_size': 1, 'snapshot_id': '7bd1da3c-313a-4508-af00-4d55ca9d812a'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ae6e9c-60a8-4df6-84cf-5247cd08f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Volume volume-e39fd008-3c77-4b36-aaad-cc3a42723519 (e39fd008-3c77-4b36-aaad-cc3a42723519): created successfully Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ae6e9c-60a8-4df6-84cf-5247cd08f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Flow 'volume_create_manager' (5ec00878-d841-48cf-a0ff-2e628f00838c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-575d65dc-a000-4b11-8666-6dc9c8a199d4 tempest-SnapshotDependencyTests-2087901085 None] Created volume successfully. Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-7bd1da3c-313a-4508-af00-4d55ca9d812a-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-7bd1da3c-313a-4508-af00-4d55ca9d812a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-quobyte-6619966a-24a3-473e-9489-5aa0bc587ecc" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-6619966a-24a3-473e-9489-5aa0bc587ecc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-quobyte-7bd1da3c-313a-4508-af00-4d55ca9d812a" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-7bd1da3c-313a-4508-af00-4d55ca9d812a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Deleting offline snapshot 7bd1da3c-313a-4508-af00-4d55ca9d812a of volume 6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] snapshot_file for this snap is: volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b0f264-1215-47dc-a7b5-3ea5eae2a53c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:17 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 1073741824" returned: 0 in 0.476s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:17 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 Sep 29 12:12:17 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:17 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a Sep 29 12:12:17 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:17 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95" returned: 0 in 0.248s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da40a7b0-08c4-4a0a-9d6a-0f5bb9ed81de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71035b11-fe7e-4d08-9975-356259eae0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Volume volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 (9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95): created successfully Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71035b11-fe7e-4d08-9975-356259eae0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Flow 'volume_create_manager' (051a4a67-1bfe-48d6-8d51-950f7deb2c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a50b42b2-f96e-4fcd-b500-d6cda2a4e2a0 tempest-ProjectReaderTests-41138783 None] Created volume successfully. Sep 29 12:12:17 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a" returned: 0 in 0.382s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6619966a-24a3-473e-9489-5aa0bc587ecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d168a0e8-fe21-4c4c-b955-8e481c7bf247]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:17 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc Sep 29 12:12:17 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Acquiring lock "cinder-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Lock "cinder-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Acquiring lock "cinder-quobyte-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Lock "cinder-quobyte-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a85d67-2fa7-4da8-90c3-e4b361c2e958]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:17 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 Sep 29 12:12:17 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:17 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc" returned: 0 in 0.579s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:18 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a Sep 29 12:12:18 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:18 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95" returned: 0 in 0.362s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:18 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95 Sep 29 12:12:18 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:18 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a" returned: 0 in 0.341s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:18 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a Sep 29 12:12:18 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:18 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95" returned: 0 in 0.255s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Lock "cinder-quobyte-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95" released by "delete_volume" :: held 0.668s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Created reservations ['5546ff0f-74d5-41e9-8d71-25a3e6ed65b3', 'a9b6f534-53fc-4cb2-bd82-8572f4d5ae07', '481900de-1942-433f-aa92-bdb49c081d0a', '711a15cf-99c7-4397-8c88-b5d273f2e039'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:18 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc.7bd1da3c-313a-4508-af00-4d55ca9d812a" returned: 0 in 0.263s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:18 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:18 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-7bd1da3c-313a-4508-af00-4d55ca9d812a" released by "_delete_snapshot" :: held 1.668s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-6619966a-24a3-473e-9489-5aa0bc587ecc" released by "delete_snapshot" :: held 1.691s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Created reservations ['10364a73-592b-405a-9088-7eb97dc58a10', '7e9c57e3-84c2-4126-8b07-52f6fc15ea2e', '543113d8-844e-4273-b789-3db248ca0ca0', 'd55ec10e-7b27-4b4d-88bd-5693b3bb94ce'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Delete snapshot completed successfully. Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a8a18f61-3290-45f1-bc28-d8e528003e3b tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-7bd1da3c-313a-4508-af00-4d55ca9d812a-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:18 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.299s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Deleted volume successfully. Sep 29 12:12:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6b42d406-0df8-4663-b3e2-3a06754ab2e8 tempest-ProjectReaderTests-41138783 None] Lock "cinder-9a9e03e1-f6c2-4d0e-9d21-696cda2e9d95-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-6619966a-24a3-473e-9489-5aa0bc587ecc-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-6619966a-24a3-473e-9489-5aa0bc587ecc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-quobyte-6619966a-24a3-473e-9489-5aa0bc587ecc" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-6619966a-24a3-473e-9489-5aa0bc587ecc" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c360f37e-f3f9-455a-847f-cfd6238d5832]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:19 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc Sep 29 12:12:19 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Flow 'volume_create_manager' (94774d81-c887-4e11-b50c-d7e2cd85646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe23a02-8402-4055-9fb9-c3a388120bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe23a02-8402-4055-9fb9-c3a388120bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-885944528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca563c0c-533e-45c1-a4ee-fb1ab691f15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9bee2f67d24193a00ac2054f1d8b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:19Z,use_quota=True,user_id='17e3dc7be0f24cddbcae509731fedab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9ee99e-32c4-4bf4-8101-7dc24d17b605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9ee99e-32c4-4bf4-8101-7dc24d17b605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b871c457-00f2-4856-8439-eaa13361bc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b871c457-00f2-4856-8439-eaa13361bc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca563c0c-533e-45c1-a4ee-fb1ab691f15e', 'volume_name': 'volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c40e733-6b3f-4e3e-af47-28e3e0bf978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c40e733-6b3f-4e3e-af47-28e3e0bf978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92a37f8-ba85-43be-b34e-a86532aa952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:19 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Volume ca563c0c-533e-45c1-a4ee-fb1ab691f15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e', 'volume_size': 1} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-885944528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca563c0c-533e-45c1-a4ee-fb1ab691f15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9bee2f67d24193a00ac2054f1d8b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:19Z,use_quota=True,user_id='17e3dc7be0f24cddbcae509731fedab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Creating volume ca563c0c-533e-45c1-a4ee-fb1ab691f15e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:19 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:19 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e 1073741824 Sep 29 12:12:19 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:19 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc" returned: 0 in 0.369s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:19 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc Sep 29 12:12:19 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:19 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6619966a-24a3-473e-9489-5aa0bc587ecc" returned: 0 in 0.254s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-6619966a-24a3-473e-9489-5aa0bc587ecc" released by "delete_volume" :: held 0.707s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:19 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e 1073741824" returned: 0 in 0.435s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Created reservations ['e59647c3-8ee4-406e-8225-2fe4a0b335b9', '7f6849cd-006a-4ac9-bf90-7694b7c78f21', 'e70bee36-fc8e-49d0-b92f-c0fb601345d7', 'db222f5e-b848-427c-81e2-40140ddaf9ab'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:19 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e Sep 29 12:12:19 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:20 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:20 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:20 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e" returned: 0 in 0.270s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92a37f8-ba85-43be-b34e-a86532aa952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36840805-3fd8-412f-aee2-0c0d19992ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-e39fd008-3c77-4b36-aaad-cc3a42723519-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:20 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.277s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:20 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Volume volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e (ca563c0c-533e-45c1-a4ee-fb1ab691f15e): created successfully Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36840805-3fd8-412f-aee2-0c0d19992ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Flow 'volume_create_manager' (94774d81-c887-4e11-b50c-d7e2cd85646f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Deleted volume successfully. Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-e39fd008-3c77-4b36-aaad-cc3a42723519-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-518d5d93-c9d2-42b0-8e6c-f58404901adc tempest-ProjectReaderTests-41138783 None] Created volume successfully. Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5ec7fda9-ce1e-4d79-a67f-35236ccd877a tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-6619966a-24a3-473e-9489-5aa0bc587ecc-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "cinder-quobyte-e39fd008-3c77-4b36-aaad-cc3a42723519" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-e39fd008-3c77-4b36-aaad-cc3a42723519" acquired by "delete_volume" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab2d863-8429-4d0b-976c-2642f7ecc6b4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Acquiring lock "cinder-ca563c0c-533e-45c1-a4ee-fb1ab691f15e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Lock "cinder-ca563c0c-533e-45c1-a4ee-fb1ab691f15e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Acquiring lock "cinder-quobyte-ca563c0c-533e-45c1-a4ee-fb1ab691f15e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Lock "cinder-quobyte-ca563c0c-533e-45c1-a4ee-fb1ab691f15e" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:20 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 Sep 29 12:12:20 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b920f81-2314-4afd-962d-f402071ecfea]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:20 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e Sep 29 12:12:20 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:20 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519" returned: 0 in 0.382s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:20 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519 Sep 29 12:12:20 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:20 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e" returned: 0 in 0.370s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:20 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e Sep 29 12:12:20 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:21 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e39fd008-3c77-4b36-aaad-cc3a42723519" returned: 0 in 0.247s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-quobyte-e39fd008-3c77-4b36-aaad-cc3a42723519" released by "delete_volume" :: held 0.680s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Created reservations ['8edde104-fc4d-4301-b9d6-d4b6f087064a', '5788068f-0dd8-4fe9-821d-ede2372f89ba', '00d4173a-b818-4d1a-8323-eb8e91cbe4b2', '9283b2d3-351f-4372-afd6-cfe987be830a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:21 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ca563c0c-533e-45c1-a4ee-fb1ab691f15e" returned: 0 in 0.252s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Lock "cinder-quobyte-ca563c0c-533e-45c1-a4ee-fb1ab691f15e" released by "delete_volume" :: held 0.670s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:21 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:21 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Created reservations ['b31b656d-9d5b-4736-a1a2-d3dfe2a7d4e2', 'b0e3e14d-6a60-4ced-853d-f144fd9b54e8', 'f36a6359-749e-4fdf-84a1-196031f9879b', '588e9635-f83a-4b1f-a55f-cd314c3e11e0'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:21 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:21 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:21 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.277s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Deleted volume successfully. Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ba6441a8-8944-45a6-b5b1-6404323cdf04 tempest-SnapshotDependencyTests-2087901085 None] Lock "cinder-e39fd008-3c77-4b36-aaad-cc3a42723519-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:21 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.294s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Deleted volume successfully. Sep 29 12:12:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f3f9d34b-e745-4d15-9b17-f76623adfcb6 tempest-ProjectReaderTests-41138783 None] Lock "cinder-ca563c0c-533e-45c1-a4ee-fb1ab691f15e-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:31 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=31,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:12:31 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=30,cinder:UPDATE=43,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (786a29f5-f12c-4ffd-b236-196117849bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7284bfd-b5ad-4d5a-97f3-69512da585e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7284bfd-b5ad-4d5a-97f3-69512da585e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139327682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ca2b57-9553-4692-8109-bd8f20ded483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:42Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a74a74-cad0-4a1b-8779-33629bd779f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a74a74-cad0-4a1b-8779-33629bd779f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3be8e0-bf9e-4dc1-979d-32e68188000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3be8e0-bf9e-4dc1-979d-32e68188000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ca2b57-9553-4692-8109-bd8f20ded483', 'volume_name': 'volume-33ca2b57-9553-4692-8109-bd8f20ded483', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0d2068-1e7b-4735-8016-0984112fb788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0d2068-1e7b-4735-8016-0984112fb788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087bbe0b-524e-4a70-9a05-9cb484c3417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume 33ca2b57-9553-4692-8109-bd8f20ded483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ca2b57-9553-4692-8109-bd8f20ded483', 'volume_size': 1} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139327682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ca2b57-9553-4692-8109-bd8f20ded483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:42Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Creating volume 33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:42 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:42 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 1073741824 Sep 29 12:12:42 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (b7a9268b-af43-439d-9769-b26e9c7ffca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76064ad-7263-4d68-b0da-e2a96e08d359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76064ad-7263-4d68-b0da-e2a96e08d359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069669739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4883c69-7650-4ff3-a43d-e839e6c96489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:43Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ac3ad1-72da-4c40-9ea8-09216b7cddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ac3ad1-72da-4c40-9ea8-09216b7cddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90dc388-d7cd-43cd-86b7-9bdac7075eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90dc388-d7cd-43cd-86b7-9bdac7075eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4883c69-7650-4ff3-a43d-e839e6c96489', 'volume_name': 'volume-b4883c69-7650-4ff3-a43d-e839e6c96489', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca32a4f-3ffe-4bd4-a067-e44478e0f4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca32a4f-3ffe-4bd4-a067-e44478e0f4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2736f3-aead-4841-b967-cbcf2ae6bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:42 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume b4883c69-7650-4ff3-a43d-e839e6c96489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4883c69-7650-4ff3-a43d-e839e6c96489', 'volume_size': 1} Sep 29 12:12:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:43 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 1073741824" returned: 0 in 0.552s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:43 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 Sep 29 12:12:43 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:43 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483" returned: 0 in 0.263s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069669739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4883c69-7650-4ff3-a43d-e839e6c96489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:43Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Creating volume b4883c69-7650-4ff3-a43d-e839e6c96489 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:43 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087bbe0b-524e-4a70-9a05-9cb484c3417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ca2b57-9553-4692-8109-bd8f20ded483', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9641702-7375-47c9-b7a5-0089d6c08129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:43 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 1073741824 Sep 29 12:12:43 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:43 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume volume-33ca2b57-9553-4692-8109-bd8f20ded483 (33ca2b57-9553-4692-8109-bd8f20ded483): created successfully Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9641702-7375-47c9-b7a5-0089d6c08129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:43 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (786a29f5-f12c-4ffd-b236-196117849bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0276639e-8f3a-4635-8ca7-d9de3c88fdbb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created volume successfully. Sep 29 12:12:44 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 1073741824" returned: 0 in 0.577s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:44 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 Sep 29 12:12:44 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:44 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489" returned: 0 in 0.267s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2736f3-aead-4841-b967-cbcf2ae6bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4883c69-7650-4ff3-a43d-e839e6c96489', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7389a00e-6b59-496a-938b-868dcc61970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:44 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume volume-b4883c69-7650-4ff3-a43d-e839e6c96489 (b4883c69-7650-4ff3-a43d-e839e6c96489): created successfully Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7389a00e-6b59-496a-938b-868dcc61970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (b7a9268b-af43-439d-9769-b26e9c7ffca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-25fad4b3-fba3-43f3-b683-995f36ddbafc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created volume successfully. Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Creating offline snapshot c9e977fa-ca0a-42a9-ac9f-280df29aa972 of volume 33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d7990d-926e-44e1-a6df-9a9a3ff675e8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:44 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 Sep 29 12:12:44 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:45 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483" returned: 0 in 0.519s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:45 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 1G Sep 29 12:12:45 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (69ed85c8-55ae-45e9-ad13-f9ff6aca4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af686e58-333e-4d7d-9090-bfacc3e3c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af686e58-333e-4d7d-9090-bfacc3e3c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793765228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683f5123-5042-40ae-8c3a-bf34b3f0c493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:45Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7329cbe-5cfd-40ac-b011-bcba64dc8c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7329cbe-5cfd-40ac-b011-bcba64dc8c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f6c11f-84b5-49f8-8e96-d855893b0922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f6c11f-84b5-49f8-8e96-d855893b0922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683f5123-5042-40ae-8c3a-bf34b3f0c493', 'volume_name': 'volume-683f5123-5042-40ae-8c3a-bf34b3f0c493', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5ab119-cc00-4d05-958b-25bd4dd8c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5ab119-cc00-4d05-958b-25bd4dd8c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eebd1a7-f665-4f2b-9326-0f12e6ea6e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:45 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume 683f5123-5042-40ae-8c3a-bf34b3f0c493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683f5123-5042-40ae-8c3a-bf34b3f0c493', 'volume_size': 1} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Flow 'volume_create_manager' (9c4d2465-d93d-4776-bad0-cab9700ceed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95089734-fb56-46b7-b9fb-a420cb952fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:45 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 1G" returned: 0 in 0.672s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ca2b57-9553-4692-8109-bd8f20ded483 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95089734-fb56-46b7-b9fb-a420cb952fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c622e5-dee4-4a24-a6fd-930a924d131a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ca69f08f18495c820cb00268b9750e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:46Z,use_quota=True,user_id='1f065610372f4bc99d13e95821e1f2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a9046b-e86f-4db6-8e05-c6da419a65b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ca2b57-9553-4692-8109-bd8f20ded483 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 Sep 29 12:12:46 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a9046b-e86f-4db6-8e05-c6da419a65b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad04e040-53d3-4e27-8493-0ea5333727ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (644fdbf1-fd62-4fc2-b27d-00d02a3ad681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db93614-5e55-4196-bb4c-7ea5882aa493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db93614-5e55-4196-bb4c-7ea5882aa493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220427099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dbd96a-ac25-475f-b1f5-e850d96e77f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:46Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b131e57-b705-4597-94a5-9766c7083599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b131e57-b705-4597-94a5-9766c7083599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d28b04c-42fe-4ec5-9aa5-be84d5e3b6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d28b04c-42fe-4ec5-9aa5-be84d5e3b6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1dbd96a-ac25-475f-b1f5-e850d96e77f3', 'volume_name': 'volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c569ed7d-1720-4ab8-87b2-7ad16cd64821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c569ed7d-1720-4ab8-87b2-7ad16cd64821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d095545-6fc8-48f0-a814-9b14492eb168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume c1dbd96a-ac25-475f-b1f5-e850d96e77f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3', 'volume_size': 1} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (b8ed6ae0-5b5e-4420-8a99-7284214cbc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:46 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9b5817-b55d-4fcd-a026-f14362087b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ca2b57-9553-4692-8109-bd8f20ded483 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972" returned: 0 in 0.554s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:46 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 is being set with open permissions: ugo+rw Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:46 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 Sep 29 12:12:46 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9b5817-b55d-4fcd-a026-f14362087b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118221242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c513ee-b3b9-49c5-aa0d-ec2413f84530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:46Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678f70b3-5cb9-4389-a217-4bf3b92be6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678f70b3-5cb9-4389-a217-4bf3b92be6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2049ce-fb15-40ea-896a-4f800a837880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2049ce-fb15-40ea-896a-4f800a837880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c513ee-b3b9-49c5-aa0d-ec2413f84530', 'volume_name': 'volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f277b497-ec20-4949-b5d2-675950c8b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f277b497-ec20-4949-b5d2-675950c8b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea37042-2c87-41a1-b64d-fe6d6cc33572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume a5c513ee-b3b9-49c5-aa0d-ec2413f84530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530', 'volume_size': 1} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad04e040-53d3-4e27-8493-0ea5333727ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2c622e5-dee4-4a24-a6fd-930a924d131a', 'volume_name': 'volume-e2c622e5-dee4-4a24-a6fd-930a924d131a', 'volume_size': 1, 'image_id': '4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55e8973b394ffa234dcbab7cba57f3bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9ca69f08f18495c820cb00268b9750e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51a8d971e694a484ea86d3ed12c04fbaa83f8dd4307b7f33ab624fc35ff35890f4fd72f7724e0f3cc0969750d23f1b7b32992e020dca9bffbea5af4e60c64f17', 'id': '4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'created_at': datetime.datetime(2026, 9, 29, 10, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a/file', 'properties': {}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b43f20d-3073-4eb7-9a89-daaab366a633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b43f20d-3073-4eb7-9a89-daaab366a633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37992081-1a8e-42eb-8811-4547bf84bc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Volume e2c622e5-dee4-4a24-a6fd-930a924d131a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2c622e5-dee4-4a24-a6fd-930a924d131a', 'volume_size': 1, 'image_id': '4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55e8973b394ffa234dcbab7cba57f3bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9ca69f08f18495c820cb00268b9750e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51a8d971e694a484ea86d3ed12c04fbaa83f8dd4307b7f33ab624fc35ff35890f4fd72f7724e0f3cc0969750d23f1b7b32992e020dca9bffbea5af4e60c64f17', 'id': '4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'created_at': datetime.datetime(2026, 9, 29, 10, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a/file', 'properties': {}}, 'image_service': } Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Trying to clone e2c622e5-dee4-4a24-a6fd-930a924d131a from image 4b9cfa07-e17e-4fba-90ba-41424805fd6a at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Flow 'volume_create_manager' (069f0670-1dc4-4f18-aad3-3713d3e4b46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:46 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cef81d-50e6-45a5-a214-16aedc11a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972" returned: 0 in 0.381s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:12:46 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cef81d-50e6-45a5-a214-16aedc11a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc11872-be6c-4233-8467-14a43793af81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccecd41789145309ef38ccd89a35bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:47Z,use_quota=True,user_id='39c510c348224516ac8dbba294a6be6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334d180b-5580-4266-b71f-3b0cdb610e13),volume_type_id=334d180b-5580-4266-b71f-3b0cdb610e13)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f026fe-43f6-43b8-825d-8db6e544557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f026fe-43f6-43b8-825d-8db6e544557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7044fb-92cb-4f6a-b58a-0ff0c7b8b87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG cinder.image.glance [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Creating Keystone auth plugin from conf {{(pid=86117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d2f82d-69c6-4276-a59e-6a3ade045199]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:47 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.info Sep 29 12:12:47 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (5545b5e1-ae44-40f3-bf41-436032cdce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff65a6f-43be-4bc4-8f07-d57907377c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD Sep 29 12:12:47 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff65a6f-43be-4bc4-8f07-d57907377c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547407545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26652edb-9e48-45d0-b71e-0d8b881ecffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:47Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddbd1ca-c14a-4053-b5d7-c366c15495c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddbd1ca-c14a-4053-b5d7-c366c15495c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09784a9-da22-499d-89c6-3de472fa98a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09784a9-da22-499d-89c6-3de472fa98a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26652edb-9e48-45d0-b71e-0d8b881ecffb', 'volume_name': 'volume-26652edb-9e48-45d0-b71e-0d8b881ecffb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2615e1c6-bc3d-486d-8546-784230854f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2615e1c6-bc3d-486d-8546-784230854f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286f19e5-d9b2-4bd1-9c1a-7cefd0ff6413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume 26652edb-9e48-45d0-b71e-0d8b881ecffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26652edb-9e48-45d0-b71e-0d8b881ecffb', 'volume_size': 1} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (dd562463-eb12-4a1c-b144-bda92dff681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e66c5e-6a24-4adc-999c-c9386945855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e66c5e-6a24-4adc-999c-c9386945855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414227325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bcaed9-95d6-4d03-9c7e-a32ff46dff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:47Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae6da1e-04ca-4f0f-ba89-70875032f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae6da1e-04ca-4f0f-ba89-70875032f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b4ff75-e486-4e4c-8fe8-16d7e6be5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b4ff75-e486-4e4c-8fe8-16d7e6be5273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bcaed9-95d6-4d03-9c7e-a32ff46dff09', 'volume_name': 'volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519ff8d-3f1b-400d-8f83-c275f9f20033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519ff8d-3f1b-400d-8f83-c275f9f20033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1befe919-3db8-4762-9ca7-8d68cf8220d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume 56bcaed9-95d6-4d03-9c7e-a32ff46dff09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09', 'volume_size': 1} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:47 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7044fb-92cb-4f6a-b58a-0ff0c7b8b87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cc11872-be6c-4233-8467-14a43793af81', 'volume_name': 'volume-6cc11872-be6c-4233-8467-14a43793af81', 'volume_size': 1, 'image_id': '6e834d78-72b6-457d-828e-e724c60d4283', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e834d78-72b6-457d-828e-e724c60d4283', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11d7a508396d81a93b77d323d61d9baf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bccecd41789145309ef38ccd89a35bac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '034644efc0cb8017a22d52992ee90c2380a13e76d13199cc407d79ca20db2128eb54f133aeb6e7b6aaab704e494b2efc9684060627952bba4b623a9f0562bafc', 'id': '6e834d78-72b6-457d-828e-e724c60d4283', 'created_at': datetime.datetime(2026, 9, 29, 10, 12, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 12, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e834d78-72b6-457d-828e-e724c60d4283/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d7fca6-e4a2-45d1-94fd-5e2210dc4fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d7fca6-e4a2-45d1-94fd-5e2210dc4fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231f1c0a-e069-47f2-97ae-02838c5aed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:47 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Volume 6cc11872-be6c-4233-8467-14a43793af81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cc11872-be6c-4233-8467-14a43793af81', 'volume_size': 1, 'image_id': '6e834d78-72b6-457d-828e-e724c60d4283', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e834d78-72b6-457d-828e-e724c60d4283', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11d7a508396d81a93b77d323d61d9baf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bccecd41789145309ef38ccd89a35bac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '034644efc0cb8017a22d52992ee90c2380a13e76d13199cc407d79ca20db2128eb54f133aeb6e7b6aaab704e494b2efc9684060627952bba4b623a9f0562bafc', 'id': '6e834d78-72b6-457d-828e-e724c60d4283', 'created_at': datetime.datetime(2026, 9, 29, 10, 12, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 12, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e834d78-72b6-457d-828e-e724c60d4283/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Trying to clone 6cc11872-be6c-4233-8467-14a43793af81 from image 6e834d78-72b6-457d-828e-e724c60d4283 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e834d78-72b6-457d-828e-e724c60d4283', 'metadata': {}}]). {{(pid=86117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.info" returned: 0 in 0.376s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:47 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.info is being set with open permissions: ugo+rw Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:47 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.info Sep 29 12:12:47 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 12:12:47 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Image download 0.00 MB at 0.00 MB/s Sep 29 12:12:47 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD Sep 29 12:12:47 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38e12a3-4e1d-439e-babf-0fe3e7b69352]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:47 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD Sep 29 12:12:47 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:47 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.info" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793765228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683f5123-5042-40ae-8c3a-bf34b3f0c493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:45Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Creating volume 683f5123-5042-40ae-8c3a-bf34b3f0c493 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:47 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:47 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 1073741824 Sep 29 12:12:47 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:47 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9ef3826e-d511-4c06-b306-bb7d4cde4aef tempest-CreateVolumesFromSnapshotTest-1861116059 None] Create snapshot completed successfully Sep 29 12:12:47 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Temporary image 4b9cfa07-e17e-4fba-90ba-41424805fd6a is fetched for user 1f065610372f4bc99d13e95821e1f2bf. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb37c8-d35f-45c6-af94-53b67bb3f292]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:47 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:48 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD Sep 29 12:12:48 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD Sep 29 12:12:48 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:48 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:48 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 1073741824" returned: 0 in 0.447s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:48 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:48 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:48 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 Sep 29 12:12:48 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD" returned: 1 in 0.371s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Temporary image 6e834d78-72b6-457d-828e-e724c60d4283 is fetched for user 39c510c348224516ac8dbba294a6be6e. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fecd45-8426-4880-8005-5ef7c81bf013]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:48 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD Sep 29 12:12:48 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:48 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:48 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD Sep 29 12:12:48 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493" returned: 0 in 0.284s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220427099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dbd96a-ac25-475f-b1f5-e850d96e77f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:46Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Creating volume c1dbd96a-ac25-475f-b1f5-e850d96e77f3 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:48 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:48 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 1073741824 Sep 29 12:12:48 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eebd1a7-f665-4f2b-9326-0f12e6ea6e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683f5123-5042-40ae-8c3a-bf34b3f0c493', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7aa914-e58e-4bde-a2af-34e6d051cd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:48 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 (683f5123-5042-40ae-8c3a-bf34b3f0c493): created successfully Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7aa914-e58e-4bde-a2af-34e6d051cd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (69ed85c8-55ae-45e9-ad13-f9ff6aca4edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4a3002e3-29f3-4f9b-ad43-f9accbe36c26 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created volume successfully. Sep 29 12:12:48 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (4d82c315-0273-48a2-a9f9-a56c1f45570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac7d482-a614-49af-bb20-35c419644892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac7d482-a614-49af-bb20-35c419644892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129056149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d2be3d-8fc1-4318-bb43-ac557945cb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:49Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca899023-297c-4b2f-bc2b-df9089d14ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca899023-297c-4b2f-bc2b-df9089d14ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c0216f-3456-44ac-83f9-33498150d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c0216f-3456-44ac-83f9-33498150d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d2be3d-8fc1-4318-bb43-ac557945cb5d', 'volume_name': 'volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0930105a-e535-4d20-82f7-967e67a9a791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0930105a-e535-4d20-82f7-967e67a9a791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac519a6-2394-456a-9acc-bb21064d29da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:48 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume 66d2be3d-8fc1-4318-bb43-ac557945cb5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d', 'volume_size': 1} Sep 29 12:12:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:48 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD" returned: 0 in 0.624s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:49 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD Sep 29 12:12:49 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:49 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 1073741824" returned: 0 in 0.734s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (1b5d6e3c-e21a-46d9-ab68-8d0e2f1bf1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da14d72f-abb0-4bb4-a288-396623ff1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD" returned: 1 in 0.431s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da14d72f-abb0-4bb4-a288-396623ff1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635960214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3048def6-3d2f-4346-b8be-3514fcf04267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:49Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 Sep 29 12:12:49 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055a1e98-e7dc-41f9-8660-9f3cbb10dcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055a1e98-e7dc-41f9-8660-9f3cbb10dcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb2a2b1-810d-43d6-854f-ccf78fb8e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb2a2b1-810d-43d6-854f-ccf78fb8e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3048def6-3d2f-4346-b8be-3514fcf04267', 'volume_name': 'volume-3048def6-3d2f-4346-b8be-3514fcf04267', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778bd5b3-4d12-41cc-b984-620a2fb78ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778bd5b3-4d12-41cc-b984-620a2fb78ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9cca74-45d5-444c-baaf-2fb35c0235b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume 3048def6-3d2f-4346-b8be-3514fcf04267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3048def6-3d2f-4346-b8be-3514fcf04267', 'volume_size': 1} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:49 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.050s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118221242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c513ee-b3b9-49c5-aa0d-ec2413f84530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:46Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Creating volume a5c513ee-b3b9-49c5-aa0d-ec2413f84530 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:49 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:49 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 1073741824 Sep 29 12:12:49 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d095545-6fc8-48f0-a814-9b14492eb168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e754adc-93a0-4158-ae6d-b4117df45f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (5cd18f94-1bda-49c7-947b-f24a381a9df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf23df0-0260-4262-b8fe-88871d10f937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 (c1dbd96a-ac25-475f-b1f5-e850d96e77f3): created successfully Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e754adc-93a0-4158-ae6d-b4117df45f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (644fdbf1-fd62-4fc2-b27d-00d02a3ad681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ccac374a-d0ac-4c9a-b7fa-e3b4f02226a6 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created volume successfully. Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf23df0-0260-4262-b8fe-88871d10f937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122019887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29968646-8bb3-44b0-8b9f-ab96f6157bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:50Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1f8ff4-59a2-4950-941c-c2e23525a542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1f8ff4-59a2-4950-941c-c2e23525a542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9353ee-beef-45f7-9cdb-97f1bf213f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9353ee-beef-45f7-9cdb-97f1bf213f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29968646-8bb3-44b0-8b9f-ab96f6157bc1', 'volume_name': 'volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d8b418-faa4-4977-b99e-9ebcd0196005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d8b418-faa4-4977-b99e-9ebcd0196005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de347ae2-162a-457a-a093-7f88bed434dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:49 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume 29968646-8bb3-44b0-8b9f-ab96f6157bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1', 'volume_size': 1} Sep 29 12:12:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (04ed2f7f-ebbf-494d-9a97-e90e957fdcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ecf9c4-84e6-47b0-9faa-4b8c27ba23c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ecf9c4-84e6-47b0-9faa-4b8c27ba23c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668413406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4e59cd-453b-49e6-8290-32605002525d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:50Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fba107f-3d0f-4ebf-982e-fcafb2978ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fba107f-3d0f-4ebf-982e-fcafb2978ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82c17d2-4240-4950-9526-c7e979698833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82c17d2-4240-4950-9526-c7e979698833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4e59cd-453b-49e6-8290-32605002525d', 'volume_name': 'volume-1e4e59cd-453b-49e6-8290-32605002525d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ded886-783c-4bff-984f-0cdf56ac8203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ded886-783c-4bff-984f-0cdf56ac8203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ac2dd8-6997-4891-8cb2-753efb1a75fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume 1e4e59cd-453b-49e6-8290-32605002525d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4e59cd-453b-49e6-8290-32605002525d', 'volume_size': 1} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:50 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 1073741824" returned: 0 in 0.542s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:50 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 Sep 29 12:12:50 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (047b807d-f744-4369-baa9-38e54167e701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf67f71-5475-46cc-ae86-7c2f50644b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf67f71-5475-46cc-ae86-7c2f50644b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087581028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5050b5d9-0a6b-4372-8d3d-3bfbb736df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:50Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6b729f-f05a-4c7c-b7fc-49d665f8f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6b729f-f05a-4c7c-b7fc-49d665f8f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f2d081-7832-4498-86c8-8e1d1794e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f2d081-7832-4498-86c8-8e1d1794e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5050b5d9-0a6b-4372-8d3d-3bfbb736df40', 'volume_name': 'volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2ccdd6-24dc-4e1d-afe3-ade27b07da19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2ccdd6-24dc-4e1d-afe3-ade27b07da19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890214a4-74c0-42c9-99e1-8cd0882dcf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume 5050b5d9-0a6b-4372-8d3d-3bfbb736df40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40', 'volume_size': 1} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530" returned: 0 in 0.285s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.324s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547407545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26652edb-9e48-45d0-b71e-0d8b881ecffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:47Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Creating volume 26652edb-9e48-45d0-b71e-0d8b881ecffb {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:50 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:50 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb 1073741824 Sep 29 12:12:50 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea37042-2c87-41a1-b64d-fe6d6cc33572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e227b6-ae85-40ac-a1cc-c64bc6dd68f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 (a5c513ee-b3b9-49c5-aa0d-ec2413f84530): created successfully Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e227b6-ae85-40ac-a1cc-c64bc6dd68f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (b8ed6ae0-5b5e-4420-8a99-7284214cbc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-acbb728e-ed86-4a52-8d48-7b37c2d7aa74 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created volume successfully. Sep 29 12:12:50 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb 1073741824" returned: 0 in 0.412s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:51 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb Sep 29 12:12:51 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:51 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.886s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414227325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bcaed9-95d6-4d03-9c7e-a32ff46dff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65357dd629742ba875263e136ecdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:47Z,use_quota=True,user_id='046399cc0ba842f18651c83bebb4109b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Creating volume 56bcaed9-95d6-4d03-9c7e-a32ff46dff09 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:51 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286f19e5-d9b2-4bd1-9c1a-7cefd0ff6413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26652edb-9e48-45d0-b71e-0d8b881ecffb', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:51 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 1073741824 Sep 29 12:12:51 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71079cbc-9e4a-4800-aab5-2cb05f5c34f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume volume-26652edb-9e48-45d0-b71e-0d8b881ecffb (26652edb-9e48-45d0-b71e-0d8b881ecffb): created successfully Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71079cbc-9e4a-4800-aab5-2cb05f5c34f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (5545b5e1-ae44-40f3-bf41-436032cdce3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-87b7d2c7-089c-430a-afff-a7e105d1ccfc tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created volume successfully. Sep 29 12:12:51 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 1073741824" returned: 0 in 0.431s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:51 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 Sep 29 12:12:51 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:51 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09" returned: 0 in 0.235s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.193s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c622e5-dee4-4a24-a6fd-930a924d131a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ca69f08f18495c820cb00268b9750e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:46Z,use_quota=True,user_id='1f065610372f4bc99d13e95821e1f2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Creating volume e2c622e5-dee4-4a24-a6fd-930a924d131a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:51 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1befe919-3db8-4762-9ca7-8d68cf8220d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:52 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a 1073741824 Sep 29 12:12:52 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a20421d-851e-4b33-ac89-5c8e4d554ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Volume volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 (56bcaed9-95d6-4d03-9c7e-a32ff46dff09): created successfully Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a20421d-851e-4b33-ac89-5c8e4d554ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Flow 'volume_create_manager' (dd562463-eb12-4a1c-b144-bda92dff681f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:52 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e097ab85-bd4a-4982-9aad-61b06677ed28 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created volume successfully. Sep 29 12:12:52 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a 1073741824" returned: 0 in 0.397s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:52 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a Sep 29 12:12:52 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:52 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a" returned: 0 in 0.288s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.728s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129056149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d2be3d-8fc1-4318-bb43-ac557945cb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:49Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Creating volume 66d2be3d-8fc1-4318-bb43-ac557945cb5d {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:52 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:52 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d 1073741824 Sep 29 12:12:52 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Attempting download of 4b9cfa07-e17e-4fba-90ba-41424805fd6a ((None, [{'url': 'file:///opt/stack/data/glance/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'metadata': {}}])) to volume e2c622e5-dee4-4a24-a6fd-930a924d131a. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dfa284-696e-44ae-9c40-9e4ec796f530]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b9cfa07-e17e-4fba-90ba-41424805fd6a_f8_3j71q {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-56bcaed9-95d6-4d03-9c7e-a32ff46dff09-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-56bcaed9-95d6-4d03-9c7e-a32ff46dff09-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-quobyte-56bcaed9-95d6-4d03-9c7e-a32ff46dff09" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-56bcaed9-95d6-4d03-9c7e-a32ff46dff09" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:52 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b9cfa07-e17e-4fba-90ba-41424805fd6a_f8_3j71q Sep 29 12:12:52 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf68dec-fe2b-46f5-8dd2-b7a80002c6bb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:53 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 Sep 29 12:12:53 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:53 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:53 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b9cfa07-e17e-4fba-90ba-41424805fd6a_f8_3j71q" returned: 0 in 0.375s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b9cfa07-e17e-4fba-90ba-41424805fd6a_f8_3j71q {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d 1073741824" returned: 0 in 0.534s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:53 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d Sep 29 12:12:53 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:53 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b9cfa07-e17e-4fba-90ba-41424805fd6a_f8_3j71q Sep 29 12:12:53 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:53 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09" returned: 0 in 0.410s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:53 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09 Sep 29 12:12:53 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:53 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d" returned: 0 in 0.274s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.141s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc11872-be6c-4233-8467-14a43793af81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccecd41789145309ef38ccd89a35bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:47Z,use_quota=True,user_id='39c510c348224516ac8dbba294a6be6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334d180b-5580-4266-b71f-3b0cdb610e13),volume_type_id=334d180b-5580-4266-b71f-3b0cdb610e13)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Creating volume 6cc11872-be6c-4233-8467-14a43793af81 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:53 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:53 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b9cfa07-e17e-4fba-90ba-41424805fd6a_f8_3j71q" returned: 1 in 0.368s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b9cfa07-e17e-4fba-90ba-41424805fd6a_f8_3j71q' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3cc80a-ff2d-44e6-b562-f7b0e3ecdb42]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:53 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 1073741824 Sep 29 12:12:53 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac519a6-2394-456a-9acc-bb21064d29da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef14119-f902-4fef-9671-cf7434ef9ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d (66d2be3d-8fc1-4318-bb43-ac557945cb5d): created successfully Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef14119-f902-4fef-9671-cf7434ef9ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:53 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (4d82c315-0273-48a2-a9f9-a56c1f45570c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-56bcaed9-95d6-4d03-9c7e-a32ff46dff09" returned: 0 in 0.285s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-56bcaed9-95d6-4d03-9c7e-a32ff46dff09" released by "delete_volume" :: held 0.743s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-58acca05-7b79-4e52-89ce-f7688c4cc6dc tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created volume successfully. Sep 29 12:12:53 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD Sep 29 12:12:53 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created reservations ['b325fe0f-8e94-4d0a-a367-8434e7735a95', 'ff852c0f-3363-49d9-8847-b865f7c52752', '48cbef47-7c08-4acd-bc65-58fbe2527c15', '6ec1f9d9-c09e-4fd4-82c2-795e6f308cf3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:53 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:53 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:54 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-26652edb-9e48-45d0-b71e-0d8b881ecffb-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-26652edb-9e48-45d0-b71e-0d8b881ecffb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-quobyte-26652edb-9e48-45d0-b71e-0d8b881ecffb" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-26652edb-9e48-45d0-b71e-0d8b881ecffb" acquired by "delete_volume" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:54 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:54 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 1073741824" returned: 0 in 0.646s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:54 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD Sep 29 12:12:54 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:54 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Deleted volume successfully. Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a862fd-cd66-4fda-8975-b3ad9bc4dd3b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-930cf079-e543-4bd8-922a-529d38ab0d24 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-56bcaed9-95d6-4d03-9c7e-a32ff46dff09-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:54 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 Sep 29 12:12:54 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:54 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb Sep 29 12:12:54 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:54 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] 4b9cfa07-e17e-4fba-90ba-41424805fd6a was raw, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:54 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a Sep 29 12:12:54 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:54 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81" returned: 0 in 0.257s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.076s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635960214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3048def6-3d2f-4346-b8be-3514fcf04267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:49Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Creating volume 3048def6-3d2f-4346-b8be-3514fcf04267 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:54 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:54 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 1073741824 Sep 29 12:12:54 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Attempting download of 6e834d78-72b6-457d-828e-e724c60d4283 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e834d78-72b6-457d-828e-e724c60d4283', 'metadata': {}}])) to volume 6cc11872-be6c-4233-8467-14a43793af81. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2192b-ebb3-44bf-bf61-b6ce3dae394f]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e834d78-72b6-457d-828e-e724c60d4283_cht1uzc2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:54 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb" returned: 0 in 0.475s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:54 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb Sep 29 12:12:54 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:54 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e834d78-72b6-457d-828e-e724c60d4283_cht1uzc2 Sep 29 12:12:54 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-26652edb-9e48-45d0-b71e-0d8b881ecffb" returned: 0 in 0.310s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a" returned: 0 in 0.568s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b9cfa07-e17e-4fba-90ba-41424805fd6a_2gauczfodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:12:55 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-26652edb-9e48-45d0-b71e-0d8b881ecffb" released by "delete_volume" :: held 0.868s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:55 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a 1G Sep 29 12:12:55 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e834d78-72b6-457d-828e-e724c60d4283_cht1uzc2" returned: 0 in 0.419s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e834d78-72b6-457d-828e-e724c60d4283_cht1uzc2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created reservations ['1201dd01-b7d1-436d-aff6-ead65dcfb217', 'abd5a2fb-7376-41f7-b804-5632760deb46', 'a40eae27-7758-4744-a946-4b19dc3db33e', 'c2255e57-772b-4f59-8906-f15c86ae1f77'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:55 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e834d78-72b6-457d-828e-e724c60d4283_cht1uzc2 Sep 29 12:12:55 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 1073741824" returned: 0 in 0.710s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:55 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-a5c513ee-b3b9-49c5-aa0d-ec2413f84530-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-a5c513ee-b3b9-49c5-aa0d-ec2413f84530-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:55 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 Sep 29 12:12:55 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-quobyte-a5c513ee-b3b9-49c5-aa0d-ec2413f84530" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-a5c513ee-b3b9-49c5-aa0d-ec2413f84530" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd474d-69b2-4624-ad6b-8e6c8d8f319b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:55 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e834d78-72b6-457d-828e-e724c60d4283_cht1uzc2" returned: 1 in 0.491s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e834d78-72b6-457d-828e-e724c60d4283_cht1uzc2' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb18fb5-63c7-4048-a9a7-8a2308167ae8]: (4, 'raw') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:55 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a 1G" returned: 0 in 0.548s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Downloaded image 4b9cfa07-e17e-4fba-90ba-41424805fd6a ((None, [{'url': 'file:///opt/stack/data/glance/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'metadata': {}}])) to volume e2c622e5-dee4-4a24-a6fd-930a924d131a successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Temporary image 4b9cfa07-e17e-4fba-90ba-41424805fd6a for user 1f065610372f4bc99d13e95821e1f2bf is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Marking volume e2c622e5-dee4-4a24-a6fd-930a924d131a as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Copying metadata from image 4b9cfa07-e17e-4fba-90ba-41424805fd6a to e2c622e5-dee4-4a24-a6fd-930a924d131a. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Creating volume glance metadata for volume e2c622e5-dee4-4a24-a6fd-930a924d131a backed by image 4b9cfa07-e17e-4fba-90ba-41424805fd6a with: {'image_id': '4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '55e8973b394ffa234dcbab7cba57f3bb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:12:55 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267" returned: 0 in 0.327s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:55 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 Sep 29 12:12:55 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.831s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122019887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29968646-8bb3-44b0-8b9f-ab96f6157bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:50Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Creating volume 29968646-8bb3-44b0-8b9f-ab96f6157bc1 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:55 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:55 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD Sep 29 12:12:55 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 1073741824 Sep 29 12:12:55 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9cca74-45d5-444c-baaf-2fb35c0235b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3048def6-3d2f-4346-b8be-3514fcf04267', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328ea6cd-1243-4253-a531-60e32b881d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.520s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Deleted volume successfully. Sep 29 12:12:55 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume volume-3048def6-3d2f-4346-b8be-3514fcf04267 (3048def6-3d2f-4346-b8be-3514fcf04267): created successfully Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328ea6cd-1243-4253-a531-60e32b881d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (1b5d6e3c-e21a-46d9-ab68-8d0e2f1bf1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-92164b05-d24f-43bf-9283-f0f6cc361d46 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created volume successfully. Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35a984a2-0fde-4477-bee4-6cd2ed799490 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-26652edb-9e48-45d0-b71e-0d8b881ecffb-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37992081-1a8e-42eb-8811-4547bf84bc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c622e5-dee4-4a24-a6fd-930a924d131a', 'volume_size': 1, 'image_id': '4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55e8973b394ffa234dcbab7cba57f3bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9ca69f08f18495c820cb00268b9750e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51a8d971e694a484ea86d3ed12c04fbaa83f8dd4307b7f33ab624fc35ff35890f4fd72f7724e0f3cc0969750d23f1b7b32992e020dca9bffbea5af4e60c64f17', 'id': '4b9cfa07-e17e-4fba-90ba-41424805fd6a', 'created_at': datetime.datetime(2026, 9, 29, 10, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b9cfa07-e17e-4fba-90ba-41424805fd6a/file', 'properties': {}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef3ac8-df88-4862-9358-6def2390e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:55 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Volume volume-e2c622e5-dee4-4a24-a6fd-930a924d131a (e2c622e5-dee4-4a24-a6fd-930a924d131a): created successfully Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef3ac8-df88-4862-9358-6def2390e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Flow 'volume_create_manager' (9c4d2465-d93d-4776-bad0-cab9700ceed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0aa2e41b-69af-458a-b022-2377f2d76002 tempest-VolumeImageDependencyTests-1176048618 None] Created volume successfully. Sep 29 12:12:55 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:56 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530" returned: 0 in 0.510s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:56 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530 Sep 29 12:12:56 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:56 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD Sep 29 12:12:56 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:56 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 1073741824" returned: 0 in 0.536s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:56 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 Sep 29 12:12:56 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:56 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD" returned: 1 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD' failed. Not Retrying. {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] 6e834d78-72b6-457d-828e-e724c60d4283 was raw, converting to qcow2 {{(pid=86117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:56 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-a5c513ee-b3b9-49c5-aa0d-ec2413f84530" returned: 0 in 0.301s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:56 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 Sep 29 12:12:56 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-a5c513ee-b3b9-49c5-aa0d-ec2413f84530" released by "delete_volume" :: held 0.890s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Acquiring lock "cinder-e2c622e5-dee4-4a24-a6fd-930a924d131a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created reservations ['81ae8a4d-77e9-4895-93e2-85e47fd48dce', '130cf22f-a3e3-4950-954b-dfa8f6dba412', 'c7484536-ec2f-41fd-9827-4304e0880ac1', 'b663e564-da03-4ea0-85d7-22b0fa34709c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Lock "cinder-e2c622e5-dee4-4a24-a6fd-930a924d131a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Acquiring lock "cinder-quobyte-e2c622e5-dee4-4a24-a6fd-930a924d131a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:56 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1" returned: 0 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.467s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668413406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4e59cd-453b-49e6-8290-32605002525d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:50Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Creating volume 1e4e59cd-453b-49e6-8290-32605002525d {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:56 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Lock "cinder-quobyte-e2c622e5-dee4-4a24-a6fd-930a924d131a" acquired by "delete_volume" :: waited 0.052s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:56 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d 1073741824 Sep 29 12:12:56 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de347ae2-162a-457a-a093-7f88bed434dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfc1501-6771-41e5-8d85-30d2b21832d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03182d8-faef-4805-a4cc-4a871a04de79]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:56 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 (29968646-8bb3-44b0-8b9f-ab96f6157bc1): created successfully Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfc1501-6771-41e5-8d85-30d2b21832d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:56 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (5cd18f94-1bda-49c7-947b-f24a381a9df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:56 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-15f5285d-3263-4cd9-99a3-da4af132a162 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created volume successfully. Sep 29 12:12:56 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:56 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:56 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a Sep 29 12:12:56 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:57 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81" returned: 0 in 0.687s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e834d78-72b6-457d-828e-e724c60d4283__yvzic76devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:12:57 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:57 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 1G Sep 29 12:12:57 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:57 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Deleted volume successfully. Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3572ac75-1898-4533-98e3-9e067d745628 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-a5c513ee-b3b9-49c5-aa0d-ec2413f84530-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:57 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a" returned: 0 in 0.504s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:57 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d 1073741824" returned: 0 in 0.581s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:57 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a Sep 29 12:12:57 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:57 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d Sep 29 12:12:57 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:57 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 1G" returned: 0 in 0.366s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Downloaded image 6e834d78-72b6-457d-828e-e724c60d4283 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e834d78-72b6-457d-828e-e724c60d4283', 'metadata': {}}])) to volume 6cc11872-be6c-4233-8467-14a43793af81 successfully. {{(pid=86117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Temporary image 6e834d78-72b6-457d-828e-e724c60d4283 for user 39c510c348224516ac8dbba294a6be6e is deleted. {{(pid=86117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.volume_utils [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Marking volume 6cc11872-be6c-4233-8467-14a43793af81 as bootable. {{(pid=86117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Copying metadata from image 6e834d78-72b6-457d-828e-e724c60d4283 to 6cc11872-be6c-4233-8467-14a43793af81. {{(pid=86117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Creating volume glance metadata for volume 6cc11872-be6c-4233-8467-14a43793af81 backed by image 6e834d78-72b6-457d-828e-e724c60d4283 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6e834d78-72b6-457d-828e-e724c60d4283', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '11d7a508396d81a93b77d323d61d9baf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 12:12:57 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e2c622e5-dee4-4a24-a6fd-930a924d131a" returned: 0 in 0.288s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Lock "cinder-quobyte-e2c622e5-dee4-4a24-a6fd-930a924d131a" released by "delete_volume" :: held 0.862s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231f1c0a-e069-47f2-97ae-02838c5aed62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc11872-be6c-4233-8467-14a43793af81', 'volume_size': 1, 'image_id': '6e834d78-72b6-457d-828e-e724c60d4283', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e834d78-72b6-457d-828e-e724c60d4283', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11d7a508396d81a93b77d323d61d9baf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bccecd41789145309ef38ccd89a35bac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '034644efc0cb8017a22d52992ee90c2380a13e76d13199cc407d79ca20db2128eb54f133aeb6e7b6aaab704e494b2efc9684060627952bba4b623a9f0562bafc', 'id': '6e834d78-72b6-457d-828e-e724c60d4283', 'created_at': datetime.datetime(2026, 9, 29, 10, 12, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 12, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e834d78-72b6-457d-828e-e724c60d4283/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:57 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90331a5c-92de-4af8-9d71-cf07325a0a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d" returned: 0 in 0.292s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087581028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5050b5d9-0a6b-4372-8d3d-3bfbb736df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c619c7c4a949d3ada527328e867114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:12:50Z,use_quota=True,user_id='dfca6b8bfc7d4c0aa428bb2c43103c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Creating volume 5050b5d9-0a6b-4372-8d3d-3bfbb736df40 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:12:57 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Volume volume-6cc11872-be6c-4233-8467-14a43793af81 (6cc11872-be6c-4233-8467-14a43793af81): created successfully Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90331a5c-92de-4af8-9d71-cf07325a0a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Flow 'volume_create_manager' (069f0670-1dc4-4f18-aad3-3713d3e4b46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:57 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 1073741824 Sep 29 12:12:57 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-c1dbd96a-ac25-475f-b1f5-e850d96e77f3-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ac2dd8-6997-4891-8cb2-753efb1a75fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4e59cd-453b-49e6-8290-32605002525d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1230a0e7-6133-49ee-8ce4-bca427a14074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cb5e8854-62df-42cb-8f3d-51981de3e26f tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Created volume successfully. Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-c1dbd96a-ac25-475f-b1f5-e850d96e77f3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:57 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume volume-1e4e59cd-453b-49e6-8290-32605002525d (1e4e59cd-453b-49e6-8290-32605002525d): created successfully Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1230a0e7-6133-49ee-8ce4-bca427a14074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (04ed2f7f-ebbf-494d-9a97-e90e957fdcdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Created reservations ['657a536a-3660-44ea-b4b3-f4e749202a2f', '28724152-6a5d-4b46-893b-7df305ca4eb7', 'f7cb7d01-6596-4e12-8a08-05e2aa3f5d16', '44d9f884-aa91-4b88-ad5f-9d4360ae43c7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d21d025a-68be-4760-bb1c-8c058bbefcd0 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created volume successfully. Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-quobyte-c1dbd96a-ac25-475f-b1f5-e850d96e77f3" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-c1dbd96a-ac25-475f-b1f5-e850d96e77f3" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[17801a22-944c-431a-bb14-132f174a0219]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:57 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:57 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:58 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 Sep 29 12:12:58 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:58 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 1073741824" returned: 0 in 0.539s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:58 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 Sep 29 12:12:58 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:58 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.318s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Deleted volume successfully. Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c548e38e-872d-43d3-8916-5c051db84500 tempest-VolumeImageDependencyTests-1176048618 None] Lock "cinder-e2c622e5-dee4-4a24-a6fd-930a924d131a-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:58 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:58 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3 Sep 29 12:12:58 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:58 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40" returned: 0 in 0.252s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890214a4-74c0-42c9-99e1-8cd0882dcf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fff385-4324-4be7-9fa4-67469831edb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:12:58 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Volume volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 (5050b5d9-0a6b-4372-8d3d-3bfbb736df40): created successfully Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fff385-4324-4be7-9fa4-67469831edb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Flow 'volume_create_manager' (047b807d-f744-4369-baa9-38e54167e701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:12:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d910acd6-68c7-4983-b670-1bd5f52210ea tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created volume successfully. Sep 29 12:12:58 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c1dbd96a-ac25-475f-b1f5-e850d96e77f3" returned: 0 in 0.254s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-c1dbd96a-ac25-475f-b1f5-e850d96e77f3" released by "delete_volume" :: held 0.757s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Acquiring lock "cinder-6cc11872-be6c-4233-8467-14a43793af81-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created reservations ['9440d84f-afa2-46be-a79a-c9b2cc6e2e9c', 'e35aad3c-9e84-4f1b-8001-d4e86d8c1147', 'c1f1afa9-be6c-4098-8186-150a89b92104', 'de4b891a-1f10-4d1e-86ab-79581e5ab993'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "cinder-6cc11872-be6c-4233-8467-14a43793af81-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Acquiring lock "cinder-quobyte-6cc11872-be6c-4233-8467-14a43793af81" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "cinder-quobyte-6cc11872-be6c-4233-8467-14a43793af81" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72619f4-6ece-4f71-99bd-00ad5b57b70c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:58 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:12:58 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-683f5123-5042-40ae-8c3a-bf34b3f0c493-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-683f5123-5042-40ae-8c3a-bf34b3f0c493-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-quobyte-683f5123-5042-40ae-8c3a-bf34b3f0c493" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-683f5123-5042-40ae-8c3a-bf34b3f0c493" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[23067055-aa1a-4262-ab3b-c00d7b0dfef2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:59 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 Sep 29 12:12:59 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:59 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 Sep 29 12:12:59 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:59 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.314s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:12:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Deleted volume successfully. Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e7404484-690b-40e5-abda-9d96e34ed438 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-c1dbd96a-ac25-475f-b1f5-e850d96e77f3-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-5050b5d9-0a6b-4372-8d3d-3bfbb736df40-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-5050b5d9-0a6b-4372-8d3d-3bfbb736df40-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-5050b5d9-0a6b-4372-8d3d-3bfbb736df40" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:12:59 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81" returned: 0 in 0.618s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-5050b5d9-0a6b-4372-8d3d-3bfbb736df40" acquired by "delete_volume" :: waited 0.047s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:12:59 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81 Sep 29 12:12:59 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66caf82-c8cc-478c-bc82-b14fd20cfd85]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:59 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493" returned: 0 in 0.557s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:12:59 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493 Sep 29 12:12:59 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:59 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 Sep 29 12:12:59 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:12:59 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-6cc11872-be6c-4233-8467-14a43793af81" returned: 0 in 0.361s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "cinder-quobyte-6cc11872-be6c-4233-8467-14a43793af81" released by "delete_volume" :: held 1.067s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:59 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-683f5123-5042-40ae-8c3a-bf34b3f0c493" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-683f5123-5042-40ae-8c3a-bf34b3f0c493" released by "delete_volume" :: held 1.028s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:12:59 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Created reservations ['7b817c6f-9d6b-4c85-860c-9d93e6da6f8c', '5809fb15-9ce5-4d70-ade5-5615efeac179', 'b00de331-96c9-4502-8e59-02e27692e0c3', 'c87e5e54-c12f-4beb-9949-3fa4b307cbfd'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created reservations ['54b4743b-9559-4878-b458-207ed4b9ba4a', 'b6a280a2-f338-417b-89fb-fed563bfbcb9', '6e7000a6-750b-4763-b4b8-973ff85691f0', 'ef06c47d-dfeb-44cb-b389-f3487795d4ea'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:00 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40" returned: 0 in 0.611s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:00 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:00 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:00 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40 Sep 29 12:13:00 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:00 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:00 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:00 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.285s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Deleted volume successfully. Sep 29 12:13:00 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-5050b5d9-0a6b-4372-8d3d-3bfbb736df40" returned: 0 in 0.294s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-5050b5d9-0a6b-4372-8d3d-3bfbb736df40" released by "delete_volume" :: held 0.977s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69a7f507-ac02-456c-aff2-3e31c7980e5d tempest-VolumeAndVolumeTypeFromImageTest-1600057568 None] Lock "cinder-6cc11872-be6c-4233-8467-14a43793af81-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created reservations ['409be8c6-6dc2-4f23-8491-3c4768827e66', 'b30b84a7-42aa-4732-a572-1f82828ad343', 'f52939a2-0553-437e-b6aa-48a1bf81bbc4', 'b6e65809-1719-489f-b01d-aa22a8befd5f'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:00 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.296s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Deleted volume successfully. Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-98d2f883-7ea3-48b2-958d-201f5ad67569 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-683f5123-5042-40ae-8c3a-bf34b3f0c493-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:00 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:00 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:00 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.278s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Deleted volume successfully. Sep 29 12:13:00 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fb5001c9-bcd3-4afb-8aa8-f4113f36ad31 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-5050b5d9-0a6b-4372-8d3d-3bfbb736df40-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-b4883c69-7650-4ff3-a43d-e839e6c96489-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-b4883c69-7650-4ff3-a43d-e839e6c96489-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "cinder-quobyte-b4883c69-7650-4ff3-a43d-e839e6c96489" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-b4883c69-7650-4ff3-a43d-e839e6c96489" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2df1ff-a170-4a92-838c-bd124467b3a7]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:01 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 Sep 29 12:13:01 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-1e4e59cd-453b-49e6-8290-32605002525d-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-1e4e59cd-453b-49e6-8290-32605002525d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:01 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489" returned: 0 in 0.481s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-1e4e59cd-453b-49e6-8290-32605002525d" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:01 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489 Sep 29 12:13:01 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-1e4e59cd-453b-49e6-8290-32605002525d" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4f958-ac5e-4609-ad56-a96add8a64f2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:01 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d Sep 29 12:13:01 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:02 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b4883c69-7650-4ff3-a43d-e839e6c96489" returned: 0 in 0.306s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-quobyte-b4883c69-7650-4ff3-a43d-e839e6c96489" released by "delete_volume" :: held 0.843s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Created reservations ['c0bcea6d-745b-443a-9378-11af9c753b7b', 'ccc8f0bc-8a6e-409e-925d-ff8f7e6ae81e', 'fc6d3439-b361-411c-85a3-e9a7183acbfd', 'ef0231d1-3306-4fb1-baa5-5547177dccf3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:02 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:02 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:02 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d" returned: 0 in 0.458s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:02 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d Sep 29 12:13:02 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:02 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:02 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-1e4e59cd-453b-49e6-8290-32605002525d" returned: 0 in 0.366s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.419s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Deleted volume successfully. Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-1e4e59cd-453b-49e6-8290-32605002525d" released by "delete_volume" :: held 0.904s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-72289147-5e65-46f9-b366-ad440c6d4fd2 tempest-CreateVolumesFromSourceVolumeTest-126079252 None] Lock "cinder-b4883c69-7650-4ff3-a43d-e839e6c96489-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created reservations ['7b4102c0-a858-4d94-ab71-aed7bfd815af', 'e7cae311-99c7-4aec-8bdd-72fb0d67d4f4', 'ac5c0849-6825-41f5-8ecb-d58ed3c8df2f', 'e0a8da17-1c07-475f-919e-fd6d6f4dd367'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:02 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:02 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:03 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.356s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:03 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:03 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Deleted volume successfully. Sep 29 12:13:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cb623e11-6901-413c-92d1-bcda1294268b tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-1e4e59cd-453b-49e6-8290-32605002525d-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-29968646-8bb3-44b0-8b9f-ab96f6157bc1-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-29968646-8bb3-44b0-8b9f-ab96f6157bc1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-29968646-8bb3-44b0-8b9f-ab96f6157bc1" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-29968646-8bb3-44b0-8b9f-ab96f6157bc1" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[44041e93-af1d-4136-9637-af295d012f68]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:04 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 Sep 29 12:13:04 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:04 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1" returned: 0 in 0.453s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:04 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1 Sep 29 12:13:04 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:04 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-29968646-8bb3-44b0-8b9f-ab96f6157bc1" returned: 0 in 0.304s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-29968646-8bb3-44b0-8b9f-ab96f6157bc1" released by "delete_volume" :: held 0.837s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created reservations ['50ac1a75-8bf9-4aeb-8ab1-8a3240b95af6', '2ef00e5a-2798-475c-98a2-addaf231314e', '7f976841-e44d-49b2-9c36-e9ed01bf5c48', '97f97034-08fc-4326-af6d-7d2cf08a01cc'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:05 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:05 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-3048def6-3d2f-4346-b8be-3514fcf04267-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-3048def6-3d2f-4346-b8be-3514fcf04267-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-3048def6-3d2f-4346-b8be-3514fcf04267" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-3048def6-3d2f-4346-b8be-3514fcf04267" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33da9af-a70f-4150-88e8-af6acd61c4c5]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:05 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:05 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Deleted volume successfully. Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-14c0d5dd-9ff5-4844-a86b-8ee7b7add3c3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-29968646-8bb3-44b0-8b9f-ab96f6157bc1-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:05 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 Sep 29 12:13:05 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:05 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:05 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267 Sep 29 12:13:05 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:06 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3048def6-3d2f-4346-b8be-3514fcf04267" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-3048def6-3d2f-4346-b8be-3514fcf04267" released by "delete_volume" :: held 0.801s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created reservations ['4243e3e8-429d-4aed-b3c5-1672438e4746', '2d861350-54d8-4e10-81a4-d5fb676ab89f', 'a6f5d35d-f988-4593-9cbc-c48c15335a82', 'd7c72a93-0ba0-49f4-b77d-a3c5a4f264bf'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:06 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:06 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-66d2be3d-8fc1-4318-bb43-ac557945cb5d-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-66d2be3d-8fc1-4318-bb43-ac557945cb5d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-66d2be3d-8fc1-4318-bb43-ac557945cb5d" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-66d2be3d-8fc1-4318-bb43-ac557945cb5d" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3657192-5b44-41fa-932a-7757dc2a9b40]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:06 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.404s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Deleted volume successfully. Sep 29 12:13:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dfb243ec-3a2b-439c-a529-463622d97fe3 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-3048def6-3d2f-4346-b8be-3514fcf04267-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:06 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d Sep 29 12:13:06 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:07 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d" returned: 0 in 0.541s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:07 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d Sep 29 12:13:07 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:07 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-66d2be3d-8fc1-4318-bb43-ac557945cb5d" returned: 0 in 0.310s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-66d2be3d-8fc1-4318-bb43-ac557945cb5d" released by "delete_volume" :: held 0.914s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created reservations ['0892647a-bd98-4115-a839-09a366f52839', '8644fb77-7747-4304-830c-a3a203c9c741', 'ef6f96e5-a62a-450e-9c89-18fcc1ba8f53', 'd9a22e14-9c91-446d-ae90-cd88c8313de7'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:07 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:07 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:08 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.336s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:08 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Deleted volume successfully. Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ebd5b793-1f60-43cb-b6fb-89762597d1cb tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-66d2be3d-8fc1-4318-bb43-ac557945cb5d-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (209bbff2-b381-4150-92e5-faae1f0a1948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffc671d-17a5-463e-b639-d824bc5689f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffc671d-17a5-463e-b639-d824bc5689f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370057843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfc5caa-c33e-40df-96bb-17fa6323088f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:08Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1467275b-79fa-4fb1-849c-888f8d1bf640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1467275b-79fa-4fb1-849c-888f8d1bf640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f0c8d7-9692-4c16-bb4b-33cdef952f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f0c8d7-9692-4c16-bb4b-33cdef952f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cfc5caa-c33e-40df-96bb-17fa6323088f', 'volume_name': 'volume-7cfc5caa-c33e-40df-96bb-17fa6323088f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2f815c-b57d-451a-9028-d2d6223ebf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2f815c-b57d-451a-9028-d2d6223ebf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a97b518-6685-47b0-b9c2-5c374c0300e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Volume 7cfc5caa-c33e-40df-96bb-17fa6323088f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cfc5caa-c33e-40df-96bb-17fa6323088f', 'volume_size': 1} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370057843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfc5caa-c33e-40df-96bb-17fa6323088f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:08Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Creating volume 7cfc5caa-c33e-40df-96bb-17fa6323088f {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:08 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:08 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f 1073741824 Sep 29 12:13:08 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (d7e867da-19f6-4719-83d0-8eabc2f0af67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561ae6f8-9ae8-40b3-8d42-3ca8da7d77b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561ae6f8-9ae8-40b3-8d42-3ca8da7d77b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-630031899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b259ab-b86d-47eb-8936-6b0defdfac37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:08Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f927742-41c1-459d-9d11-368b1bc7c2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f927742-41c1-459d-9d11-368b1bc7c2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a0dbb3-9060-4e5a-ba3a-200b33b74911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a0dbb3-9060-4e5a-ba3a-200b33b74911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b259ab-b86d-47eb-8936-6b0defdfac37', 'volume_name': 'volume-43b259ab-b86d-47eb-8936-6b0defdfac37', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a793d7f4-61b0-4cf6-9ab8-5fabfa15487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a793d7f4-61b0-4cf6-9ab8-5fabfa15487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8040da-74b2-4967-b93e-4a4aae895bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Volume 43b259ab-b86d-47eb-8936-6b0defdfac37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b259ab-b86d-47eb-8936-6b0defdfac37', 'volume_size': 1} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Flow 'volume_create_manager' (2a5c9a74-58ef-4464-b43f-46ec3d3458f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d218753-1244-4c4a-bb26-664881cc12a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d218753-1244-4c4a-bb26-664881cc12a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-131594763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ceaca8a-f562-464e-b909-c145fdfe018a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98dfe0d003914131b1aeb30ec99406d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:08Z,use_quota=True,user_id='c582b493f77b47a0be8d3cb8e6a37a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce43ed2-207e-4811-9de4-10f0827794a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce43ed2-207e-4811-9de4-10f0827794a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e79577e-06fc-42f8-9bc7-6997ca3222c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e79577e-06fc-42f8-9bc7-6997ca3222c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ceaca8a-f562-464e-b909-c145fdfe018a', 'volume_name': 'volume-3ceaca8a-f562-464e-b909-c145fdfe018a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578fa6c5-321e-4878-b805-9c4f55f88a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578fa6c5-321e-4878-b805-9c4f55f88a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a8b73-8f09-4a87-bf80-433c7fe05037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Volume 3ceaca8a-f562-464e-b909-c145fdfe018a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ceaca8a-f562-464e-b909-c145fdfe018a', 'volume_size': 1} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (e41a11d3-8957-4a23-b1f3-c82c9dee6976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5d3e9f-9deb-4e07-801c-a104fe09a3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5d3e9f-9deb-4e07-801c-a104fe09a3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317925669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:09Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695f8a86-9940-4f89-b8f2-86f75cce47b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695f8a86-9940-4f89-b8f2-86f75cce47b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3f0259-8065-4ee8-a901-3a6c6dacb410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3f0259-8065-4ee8-a901-3a6c6dacb410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e', 'volume_name': 'volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f226f2-9783-4903-8fbc-deb57ffe4ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f226f2-9783-4903-8fbc-deb57ffe4ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a82a00-24c0-4ab8-b52f-468f1abee0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:08 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Volume 7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e', 'volume_size': 1} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-c9e977fa-ca0a-42a9-ac9f-280df29aa972-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-c9e977fa-ca0a-42a9-ac9f-280df29aa972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-33ca2b57-9553-4692-8109-bd8f20ded483" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-33ca2b57-9553-4692-8109-bd8f20ded483" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-c9e977fa-ca0a-42a9-ac9f-280df29aa972" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-c9e977fa-ca0a-42a9-ac9f-280df29aa972" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Deleting offline snapshot c9e977fa-ca0a-42a9-ac9f-280df29aa972 of volume 33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] snapshot_file for this snap is: volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef5a1e-b519-434a-bae5-1a63b21c8084]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:09 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f 1073741824" returned: 0 in 0.733s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:09 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f Sep 29 12:13:09 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:09 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 Sep 29 12:13:09 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (7fe1b939-5047-42a7-a358-9e732eb7f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de792fe8-3b3c-4df1-8794-305445174413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de792fe8-3b3c-4df1-8794-305445174413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782774111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95a546e-e8d4-4bf4-8da5-17fa1ce46891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:09Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d124db02-3c0d-4726-8706-91e0fcab23c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d124db02-3c0d-4726-8706-91e0fcab23c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d457e1-9f24-47db-9888-b93604ec06a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d457e1-9f24-47db-9888-b93604ec06a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95a546e-e8d4-4bf4-8da5-17fa1ce46891', 'volume_name': 'volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c05122-36f6-4911-89c8-96b24857897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c05122-36f6-4911-89c8-96b24857897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5abab2-ff6c-4d07-8cf0-4eb5d6807118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Volume b95a546e-e8d4-4bf4-8da5-17fa1ce46891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891', 'volume_size': 1} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:09 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f" returned: 0 in 0.413s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-630031899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b259ab-b86d-47eb-8936-6b0defdfac37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:08Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Creating volume 43b259ab-b86d-47eb-8936-6b0defdfac37 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:09 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:09 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972" returned: 0 in 0.605s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ca2b57-9553-4692-8109-bd8f20ded483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:13:09 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 1073741824 Sep 29 12:13:09 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a97b518-6685-47b0-b9c2-5c374c0300e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfc5caa-c33e-40df-96bb-17fa6323088f', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b62323-4fdf-476c-b903-109df3f888b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a62923-4abe-472d-a5cc-58ce875a09f6]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:09 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Volume volume-7cfc5caa-c33e-40df-96bb-17fa6323088f (7cfc5caa-c33e-40df-96bb-17fa6323088f): created successfully Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b62323-4fdf-476c-b903-109df3f888b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (209bbff2-b381-4150-92e5-faae1f0a1948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (679f0630-3983-4c95-92f8-f709b9826321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546afcf0-2671-4601-afb2-57b4b3663459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b87369e0-5c9b-4e04-8ac3-5b84e28c53f2 tempest-CreateVolumesFromImageTest-1952584569 None] Created volume successfully. Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546afcf0-2671-4601-afb2-57b4b3663459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36095200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b90882-69f3-449c-bc12-a4d2b0dcb945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:10Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0522c9-b27d-46b4-8f30-79b263c78595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0522c9-b27d-46b4-8f30-79b263c78595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202e989a-db85-4cc6-8400-ae7605791411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202e989a-db85-4cc6-8400-ae7605791411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b90882-69f3-449c-bc12-a4d2b0dcb945', 'volume_name': 'volume-58b90882-69f3-449c-bc12-a4d2b0dcb945', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728d9108-762d-48ef-bca0-ba274e47ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728d9108-762d-48ef-bca0-ba274e47ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:09 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 Sep 29 12:13:09 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8cbb00-93c3-483e-b523-e4fcbe4699cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:09 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Volume 58b90882-69f3-449c-bc12-a4d2b0dcb945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b90882-69f3-449c-bc12-a4d2b0dcb945', 'volume_size': 1} Sep 29 12:13:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:10 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:10 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 1073741824" returned: 0 in 0.585s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483" returned: 0 in 0.500s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:10 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 Sep 29 12:13:10 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:10 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 Sep 29 12:13:10 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:10 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37" returned: 0 in 0.274s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-131594763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ceaca8a-f562-464e-b909-c145fdfe018a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98dfe0d003914131b1aeb30ec99406d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:08Z,use_quota=True,user_id='c582b493f77b47a0be8d3cb8e6a37a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Creating volume 3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:10 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8040da-74b2-4967-b93e-4a4aae895bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b259ab-b86d-47eb-8936-6b0defdfac37', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:10 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a 1073741824 Sep 29 12:13:10 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54113ed-8156-4e8c-afdd-f514777e10df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:10 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Volume volume-43b259ab-b86d-47eb-8936-6b0defdfac37 (43b259ab-b86d-47eb-8936-6b0defdfac37): created successfully Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54113ed-8156-4e8c-afdd-f514777e10df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (d7e867da-19f6-4719-83d0-8eabc2f0af67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8eefd48b-1268-463e-ab08-c327249d33b5 tempest-CreateVolumesFromImageTest-1952584569 None] Created volume successfully. Sep 29 12:13:10 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972" returned: 0 in 0.486s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:10 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972 Sep 29 12:13:10 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:11 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483.c9e977fa-ca0a-42a9-ac9f-280df29aa972" returned: 0 in 0.288s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-c9e977fa-ca0a-42a9-ac9f-280df29aa972" released by "_delete_snapshot" :: held 2.066s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-33ca2b57-9553-4692-8109-bd8f20ded483" released by "delete_snapshot" :: held 2.107s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created reservations ['c8ab5b59-e65c-4a4a-85e0-55424b06d0a0', '12ea6b71-761a-4613-89c7-1ab0f50df87b', 'f8fcf410-4753-4164-a8fb-6a9e5e630772', 'e915f445-ccf6-49e7-ab3d-a8589837d482'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:11 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a 1073741824" returned: 0 in 0.607s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Delete snapshot completed successfully. Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-255ecad9-aca5-44bc-8973-8a9f6b98df83 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-c9e977fa-ca0a-42a9-ac9f-280df29aa972-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:11 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a Sep 29 12:13:11 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:11 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a" returned: 0 in 0.260s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.606s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317925669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:09Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Creating volume 7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:11 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a8b73-8f09-4a87-bf80-433c7fe05037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ceaca8a-f562-464e-b909-c145fdfe018a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446721c0-14f3-49fb-b638-90d31100ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:11 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e 1073741824 Sep 29 12:13:11 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:11 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Volume volume-3ceaca8a-f562-464e-b909-c145fdfe018a (3ceaca8a-f562-464e-b909-c145fdfe018a): created successfully Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446721c0-14f3-49fb-b638-90d31100ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Flow 'volume_create_manager' (2a5c9a74-58ef-4464-b43f-46ec3d3458f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-570c11d7-b39e-4095-89a5-d899cc6858a2 tempest-VolumeDependencyTests-1556572638 None] Created volume successfully. Sep 29 12:13:11 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e 1073741824" returned: 0 in 0.463s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:12 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e Sep 29 12:13:12 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:12 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:12 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-33ca2b57-9553-4692-8109-bd8f20ded483-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:12 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:12 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-33ca2b57-9553-4692-8109-bd8f20ded483-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e" returned: 0 in 0.389s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782774111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95a546e-e8d4-4bf4-8da5-17fa1ce46891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:09Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Creating volume b95a546e-e8d4-4bf4-8da5-17fa1ce46891 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:12 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.339s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a82a00-24c0-4ab8-b52f-468f1abee0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:12 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 1073741824 Sep 29 12:13:12 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cd831f-6e6e-4f2e-ad82-f8e486cb5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:13:12 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Volume volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e (7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e): created successfully Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cd831f-6e6e-4f2e-ad82-f8e486cb5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (e41a11d3-8957-4a23-b1f3-c82c9dee6976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:12 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b410adcd-ff5d-4845-b0a9-ec48ec93f2f9 tempest-CreateVolumesFromImageTest-1952584569 None] Created volume successfully. Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "cinder-quobyte-33ca2b57-9553-4692-8109-bd8f20ded483" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-33ca2b57-9553-4692-8109-bd8f20ded483" acquired by "delete_volume" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2c624e-b770-4ea8-815e-bd76b798b17d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:12 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 Sep 29 12:13:12 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:13 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 1073741824" returned: 0 in 0.630s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:13 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 Sep 29 12:13:13 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:13 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483" returned: 0 in 0.484s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:13 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483 Sep 29 12:13:13 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:13 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891" returned: 0 in 0.288s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.464s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36095200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b90882-69f3-449c-bc12-a4d2b0dcb945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f6c3696e33490c9f8ffccbbd05378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:10Z,use_quota=True,user_id='e731e11609564abdb186ed23dbb99005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Creating volume 58b90882-69f3-449c-bc12-a4d2b0dcb945 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:13 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5abab2-ff6c-4d07-8cf0-4eb5d6807118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:13 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 1073741824 Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6a59d4-b49a-4e4c-8350-d2a8dc16d679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:13 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:13 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-33ca2b57-9553-4692-8109-bd8f20ded483" returned: 0 in 0.286s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Volume volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 (b95a546e-e8d4-4bf4-8da5-17fa1ce46891): created successfully Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6a59d4-b49a-4e4c-8350-d2a8dc16d679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (7fe1b939-5047-42a7-a358-9e732eb7f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-quobyte-33ca2b57-9553-4692-8109-bd8f20ded483" released by "delete_volume" :: held 0.867s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-869b2261-4b18-457b-83d8-ba44121001ad tempest-CreateVolumesFromImageTest-1952584569 None] Created volume successfully. Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Created reservations ['3790ffbe-e776-4f7c-b003-087d2181cac3', 'b372d1f7-ef62-44a8-b619-aef56e3fa6ff', 'e04671e4-f7b6-46ce-9c6a-20ccc2f0ab66', 'c3a9299a-2d65-48ca-8807-c1140ee1c04c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:13 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:13 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:13 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Deleted volume successfully. Sep 29 12:13:13 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 1073741824" returned: 0 in 0.538s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-75cc3430-aaac-43d5-a74c-99c2e2d03640 tempest-CreateVolumesFromSnapshotTest-1861116059 None] Lock "cinder-33ca2b57-9553-4692-8109-bd8f20ded483-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:14 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 Sep 29 12:13:14 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:14 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945" returned: 0 in 0.247s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.584s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8cbb00-93c3-483e-b523-e4fcbe4699cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b90882-69f3-449c-bc12-a4d2b0dcb945', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cf9661-abc9-4de3-886f-faaa46161fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Creating offline snapshot b6e0c297-256f-4eca-a20e-46f8f51a58c3 of volume 3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:13:14 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Volume volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 (58b90882-69f3-449c-bc12-a4d2b0dcb945): created successfully Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cf9661-abc9-4de3-886f-faaa46161fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Flow 'volume_create_manager' (679f0630-3983-4c95-92f8-f709b9826321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6428e16b-5b02-470e-86b4-043180520a11]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:14 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c3a02190-b4a9-4382-a50f-5a6417ef5754 tempest-CreateVolumesFromImageTest-1952584569 None] Created volume successfully. Sep 29 12:13:14 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a Sep 29 12:13:14 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:14 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a" returned: 0 in 0.402s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:14 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:14 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 1G Sep 29 12:13:14 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:15 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 1G" returned: 0 in 0.475s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ceaca8a-f562-464e-b909-c145fdfe018a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:15 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ceaca8a-f562-464e-b909-c145fdfe018a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 Sep 29 12:13:15 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-58b90882-69f3-449c-bc12-a4d2b0dcb945-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-58b90882-69f3-449c-bc12-a4d2b0dcb945-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-quobyte-58b90882-69f3-449c-bc12-a4d2b0dcb945" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-58b90882-69f3-449c-bc12-a4d2b0dcb945" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[184def45-4e82-49ff-a7db-db53c1dcb2c8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:15 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ceaca8a-f562-464e-b909-c145fdfe018a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3" returned: 0 in 0.404s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:15 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 is being set with open permissions: ugo+rw Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:15 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 Sep 29 12:13:15 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:15 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 Sep 29 12:13:15 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:15 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:15 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945" returned: 0 in 0.503s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:16 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945 Sep 29 12:13:16 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:16 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.info Sep 29 12:13:16 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (1de09be0-8973-4f3f-8a6e-99d9116f729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadf6d42-abaf-4f00-aeb8-7a81e78f0090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:16 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-58b90882-69f3-449c-bc12-a4d2b0dcb945" returned: 0 in 0.336s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadf6d42-abaf-4f00-aeb8-7a81e78f0090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499432317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abce95b-8e44-4f8a-a5bd-6c35b1cb155a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:16Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1bab86-933e-4ce6-9351-e2547a85651f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1bab86-933e-4ce6-9351-e2547a85651f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c6fe57-dd2e-4782-bb23-f8d2fbeb3764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c6fe57-dd2e-4782-bb23-f8d2fbeb3764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abce95b-8e44-4f8a-a5bd-6c35b1cb155a', 'volume_name': 'volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dad792-c42c-4be2-a67c-750c06ef71a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dad792-c42c-4be2-a67c-750c06ef71a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2237ffac-b608-44be-bb7d-4b98e9bf60b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Volume 7abce95b-8e44-4f8a-a5bd-6c35b1cb155a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a', 'volume_size': 1} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-58b90882-69f3-449c-bc12-a4d2b0dcb945" released by "delete_volume" :: held 0.933s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:16 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.info" returned: 0 in 0.359s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:16 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.info is being set with open permissions: ugo+rw Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:16 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.info Sep 29 12:13:16 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Created reservations ['2121d474-a908-4271-8c85-4c0035ca727e', 'aeb858b7-2fca-40b9-ae1b-a0b06f9f8445', '2eaf1e1c-6ca8-49d0-af88-278a7a0dcf82', 'ee338f28-540e-486d-875a-54176f3cdcd8'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:16 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:16 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-b95a546e-e8d4-4bf4-8da5-17fa1ce46891-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-b95a546e-e8d4-4bf4-8da5-17fa1ce46891-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-quobyte-b95a546e-e8d4-4bf4-8da5-17fa1ce46891" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-b95a546e-e8d4-4bf4-8da5-17fa1ce46891" acquired by "delete_volume" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:16 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.info" returned: 0 in 0.300s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f87202-5eca-43cf-b5ac-643788c757f2]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499432317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abce95b-8e44-4f8a-a5bd-6c35b1cb155a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:16Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Creating volume 7abce95b-8e44-4f8a-a5bd-6c35b1cb155a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:16 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:16 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a 1073741824 Sep 29 12:13:16 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d8988e8e-36c5-466e-b049-05ec76c724d1 tempest-VolumeDependencyTests-1556572638 None] Create snapshot completed successfully Sep 29 12:13:16 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.342s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:16 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Deleted volume successfully. Sep 29 12:13:16 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-81bf86ce-e106-46a9-8687-39f2901afc6e tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-58b90882-69f3-449c-bc12-a4d2b0dcb945-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:16 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 Sep 29 12:13:16 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:17 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891" returned: 0 in 0.472s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:17 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891 Sep 29 12:13:17 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:17 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a 1073741824" returned: 0 in 0.567s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:17 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a Sep 29 12:13:17 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:17 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b95a546e-e8d4-4bf4-8da5-17fa1ce46891" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-b95a546e-e8d4-4bf4-8da5-17fa1ce46891" released by "delete_volume" :: held 0.837s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Created reservations ['058e66e3-c9fa-4435-94e5-def34a56adba', 'b6c6a9bf-3d23-44cc-98f5-51bf129e4bb3', 'a00f5485-e69e-4859-a092-806cc17fabc6', 'fca6213b-4860-4293-b950-2a7e4f250360'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:17 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2237ffac-b608-44be-bb7d-4b98e9bf60b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdbe776-2dc2-4464-9fdb-64bd0b62da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:17 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:17 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Volume volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a (7abce95b-8e44-4f8a-a5bd-6c35b1cb155a): created successfully Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdbe776-2dc2-4464-9fdb-64bd0b62da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (1de09be0-8973-4f3f-8a6e-99d9116f729a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d2283311-b78d-4636-8a8e-2aec8ba4dc7b tempest-ProjectReaderTests-721195502 None] Created volume successfully. Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-quobyte-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:17 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.301s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Deleted volume successfully. Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c47f53-7ed0-4563-b463-8e313e85c099]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6f980e8d-1355-42f3-99a7-cc0b26c97cce tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-b95a546e-e8d4-4bf4-8da5-17fa1ce46891-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:18 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e Sep 29 12:13:18 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:18 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e" returned: 0 in 0.493s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:18 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e Sep 29 12:13:18 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Flow 'volume_create_manager' (699847ac-66c2-420c-bc72-5ce692435413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f731aebc-0733-4858-9a0a-ad54bc0f25c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f731aebc-0733-4858-9a0a-ad54bc0f25c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-316273182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc355b6f-7580-49d4-908a-c1c53cb86739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98dfe0d003914131b1aeb30ec99406d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6e0c297-256f-4eca-a20e-46f8f51a58c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:18Z,use_quota=True,user_id='c582b493f77b47a0be8d3cb8e6a37a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b24f3-eb3e-4a36-8783-c223c73b362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b24f3-eb3e-4a36-8783-c223c73b362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57349f2d-da9f-4898-b8a0-32fd2abae593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57349f2d-da9f-4898-b8a0-32fd2abae593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc355b6f-7580-49d4-908a-c1c53cb86739', 'volume_name': 'volume-fc355b6f-7580-49d4-908a-c1c53cb86739', 'volume_size': 1, 'snapshot_id': 'b6e0c297-256f-4eca-a20e-46f8f51a58c3'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605ce0d6-3e08-47fc-a9c1-2ecdbfc68506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605ce0d6-3e08-47fc-a9c1-2ecdbfc68506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed0653c-5e3d-45a8-8550-97607d8b252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:18 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Volume fc355b6f-7580-49d4-908a-c1c53cb86739: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc355b6f-7580-49d4-908a-c1c53cb86739', 'volume_size': 1, 'snapshot_id': 'b6e0c297-256f-4eca-a20e-46f8f51a58c3'} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-79f58f56-724b-4353-af9f-7771e8b29da3 tempest-ProjectAdminTests-1963978833 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0487976074219, 'free_capacity_gb': 1775.0487976074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86117) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-quobyte-b6e0c297-256f-4eca-a20e-46f8f51a58c3-fc355b6f-7580-49d4-908a-c1c53cb86739" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-b6e0c297-256f-4eca-a20e-46f8f51a58c3-fc355b6f-7580-49d4-908a-c1c53cb86739" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Creating volume fc355b6f-7580-49d4-908a-c1c53cb86739 from snapshot b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-quobyte-fc355b6f-7580-49d4-908a-c1c53cb86739" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Lock "cinder-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-fc355b6f-7580-49d4-908a-c1c53cb86739" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] snapshot: b6e0c297-256f-4eca-a20e-46f8f51a58c3, volume: fc355b6f-7580-49d4-908a-c1c53cb86739, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:13:18 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-quobyte-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d70cd37-a695-4325-b225-7d02e2aa831e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e" released by "delete_volume" :: held 0.906s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a" acquired by "delete_volume" :: waited 0.042s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[75282741-7d9a-4335-b684-c4b7c9a6b138]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:19 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 Sep 29 12:13:19 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Created reservations ['e0e9a244-fca1-4088-8bef-a419f4d41dcf', 'e88b5af0-f8f2-418f-ad80-8218dcff02e4', '77912bfe-c9c8-4789-bce5-10e0b4e9b9f9', '37572838-8ad7-48e9-8361-372f81ef6828'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:19 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a Sep 29 12:13:19 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:19 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:19 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:19 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3" returned: 0 in 0.614s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ceaca8a-f562-464e-b909-c145fdfe018a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d76a6e-ea18-4b47-9bbc-d38c097a7ceb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:19 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a" returned: 0 in 0.599s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:19 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a Sep 29 12:13:19 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:19 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.499s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Deleted volume successfully. Sep 29 12:13:19 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a Sep 29 12:13:19 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c05abb7d-6943-4282-8f62-c026324232ee tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-7ed5c8e7-3ebb-4354-acf8-bf115b8d9b4e-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:19 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a" released by "delete_volume" :: held 1.096s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Created reservations ['7bed118b-e5e6-4c8b-a193-526707ce9f3b', 'd810531e-38fd-4242-b31d-edeeebf639eb', '63be36a1-91b7-49de-9125-d100e6702eaa', '5655956a-f023-4cfe-8ba3-6bc4b05bfeb3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:20 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a" returned: 0 in 0.589s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:20 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 Sep 29 12:13:20 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:20 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:20 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-43b259ab-b86d-47eb-8936-6b0defdfac37-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-43b259ab-b86d-47eb-8936-6b0defdfac37-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-quobyte-43b259ab-b86d-47eb-8936-6b0defdfac37" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-43b259ab-b86d-47eb-8936-6b0defdfac37" acquired by "delete_volume" :: waited 0.030s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ccb54e-9189-407b-bc1c-072d7973e80b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:20 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.381s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Deleted volume successfully. Sep 29 12:13:20 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 Sep 29 12:13:20 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0c581895-b65e-435d-8e29-9aad11d01777 tempest-ProjectReaderTests-721195502 None] Lock "cinder-7abce95b-8e44-4f8a-a5bd-6c35b1cb155a-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:21 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37" returned: 0 in 0.604s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:21 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37 Sep 29 12:13:21 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:21 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-43b259ab-b86d-47eb-8936-6b0defdfac37" returned: 0 in 0.521s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-43b259ab-b86d-47eb-8936-6b0defdfac37" released by "delete_volume" :: held 1.213s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:21 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Created reservations ['f972ffc4-b83a-4b6b-9386-61c4731af296', '468fa4a6-bd13-4573-a550-571d5be8d61a', 'e9df7f00-c547-4e66-9a8c-03736bc0879a', '5c00617c-3e61-42d0-bcaa-876dcb74814c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:22 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:22 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (fe626f03-05bc-4288-994f-27eedaf8416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d2d4c0-8128-45e4-8b3e-8d2136f32831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d2d4c0-8128-45e4-8b3e-8d2136f32831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691962839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d81ee3-2aed-46bc-bb82-771d1506cee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:22Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b00085a-7aa2-42db-ba6b-166167965eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b00085a-7aa2-42db-ba6b-166167965eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:22 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afb7716-7661-41c1-92b8-a50b4b9405eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afb7716-7661-41c1-92b8-a50b4b9405eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d81ee3-2aed-46bc-bb82-771d1506cee8', 'volume_name': 'volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027be7f1-7d24-4d82-8e97-578f9c70e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027be7f1-7d24-4d82-8e97-578f9c70e548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ccffe7-b12d-49b0-82a2-11f98649f4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Volume b6d81ee3-2aed-46bc-bb82-771d1506cee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8', 'volume_size': 1} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.470s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Deleted volume successfully. Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8edaa719-5eb0-4e2f-9257-0284039c56fd tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-43b259ab-b86d-47eb-8936-6b0defdfac37-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-7cfc5caa-c33e-40df-96bb-17fa6323088f-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-7cfc5caa-c33e-40df-96bb-17fa6323088f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "cinder-quobyte-7cfc5caa-c33e-40df-96bb-17fa6323088f" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-7cfc5caa-c33e-40df-96bb-17fa6323088f" acquired by "delete_volume" :: waited 0.049s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042527d-0a3c-46a1-810c-4b751844a718]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:23 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f Sep 29 12:13:23 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:23 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f" returned: 0 in 0.652s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:23 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f Sep 29 12:13:23 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:24 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-7cfc5caa-c33e-40df-96bb-17fa6323088f" returned: 0 in 0.594s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-quobyte-7cfc5caa-c33e-40df-96bb-17fa6323088f" released by "delete_volume" :: held 1.331s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Created reservations ['1f413d20-a439-43e6-8807-3dbf1a6e0e5d', '303b3657-7cfe-4a66-899d-728682026b54', '23d58884-0762-4808-8808-aa547a6a4691', 'b3da0fd3-5661-4bff-a0e4-ec626a9c3131'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:24 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:24 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:24 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.392s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:24 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:24 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Deleted volume successfully. Sep 29 12:13:25 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aacdcff8-38a8-4243-b0a6-22465d5a5307 tempest-CreateVolumesFromImageTest-1952584569 None] Lock "cinder-7cfc5caa-c33e-40df-96bb-17fa6323088f-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:28 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739" returned: 0 in 8.229s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a, size 1024.00 MB, duration 8.23 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:13:28 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Converted 1024.00 MB image at 124.43 MB/s Sep 29 12:13:28 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 is being set with open permissions: ugo+rw Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:28 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 Sep 29 12:13:28 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:28 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739" returned: 0 in 0.264s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-fc355b6f-7580-49d4-908a-c1c53cb86739" released by "_copy_volume_from_snapshot" :: held 9.854s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-b6e0c297-256f-4eca-a20e-46f8f51a58c3-fc355b6f-7580-49d4-908a-c1c53cb86739" released by "_create_volume_from_snapshot" :: held 9.948s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.971s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.979s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691962839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d81ee3-2aed-46bc-bb82-771d1506cee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:22Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Creating volume b6d81ee3-2aed-46bc-bb82-771d1506cee8 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:28 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:28 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 1073741824 Sep 29 12:13:28 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed0653c-5e3d-45a8-8550-97607d8b252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc355b6f-7580-49d4-908a-c1c53cb86739', 'volume_size': 1, 'snapshot_id': 'b6e0c297-256f-4eca-a20e-46f8f51a58c3'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23bc998-70ba-4fdb-a4cf-cef223f65140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:28 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Volume volume-fc355b6f-7580-49d4-908a-c1c53cb86739 (fc355b6f-7580-49d4-908a-c1c53cb86739): created successfully Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23bc998-70ba-4fdb-a4cf-cef223f65140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:28 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Flow 'volume_create_manager' (699847ac-66c2-420c-bc72-5ce692435413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:28 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-53506ebd-1af1-4042-acc5-fbfd05486fe0 tempest-VolumeDependencyTests-1556572638 None] Created volume successfully. Sep 29 12:13:29 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 1073741824" returned: 0 in 0.428s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:29 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 Sep 29 12:13:29 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:29 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8" returned: 0 in 0.240s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ccffe7-b12d-49b0-82a2-11f98649f4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01b66f8-9321-484e-9249-bc5e343588b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:29 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Volume volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 (b6d81ee3-2aed-46bc-bb82-771d1506cee8): created successfully Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01b66f8-9321-484e-9249-bc5e343588b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (fe626f03-05bc-4288-994f-27eedaf8416f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:29 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-556b7f57-ee0b-450f-81bf-3767f6623698 tempest-ProjectReaderTests-721195502 None] Created volume successfully. Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-b6e0c297-256f-4eca-a20e-46f8f51a58c3-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-b6e0c297-256f-4eca-a20e-46f8f51a58c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-quobyte-3ceaca8a-f562-464e-b909-c145fdfe018a" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-3ceaca8a-f562-464e-b909-c145fdfe018a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-quobyte-b6e0c297-256f-4eca-a20e-46f8f51a58c3" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-b6e0c297-256f-4eca-a20e-46f8f51a58c3" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Deleting offline snapshot b6e0c297-256f-4eca-a20e-46f8f51a58c3 of volume 3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] snapshot_file for this snap is: volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bee4e3-8804-40fe-a936-0433c662cd83]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Flow 'volume_create_manager' (96dd578b-2874-46e1-907d-112d69e0e7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:29 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa154ea-dfeb-485e-b0b2-f04d543116eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa154ea-dfeb-485e-b0b2-f04d543116eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18db6e5-afb3-45d8-a022-435a2c967eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492643ff55cb458a8e52c7d45aa46720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:30Z,use_quota=True,user_id='8d1ae24532bb4ce6ab0b3dab5b35ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384dd695-7c78-43bd-ab00-29ff746958d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384dd695-7c78-43bd-ab00-29ff746958d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9b76d8-5d0c-4857-845f-9ada0661555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9b76d8-5d0c-4857-845f-9ada0661555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e18db6e5-afb3-45d8-a022-435a2c967eef', 'volume_name': 'volume-e18db6e5-afb3-45d8-a022-435a2c967eef', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d5534a-23d7-4b1e-b3e0-063b852f130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d5534a-23d7-4b1e-b3e0-063b852f130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:30 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc9a7b6-f6cf-476a-a3a3-18d9663ba594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Volume e18db6e5-afb3-45d8-a022-435a2c967eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e18db6e5-afb3-45d8-a022-435a2c967eef', 'volume_size': 1} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18db6e5-afb3-45d8-a022-435a2c967eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492643ff55cb458a8e52c7d45aa46720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:30Z,use_quota=True,user_id='8d1ae24532bb4ce6ab0b3dab5b35ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Creating volume e18db6e5-afb3-45d8-a022-435a2c967eef {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:30 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:30 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:30 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef 1073741824 Sep 29 12:13:30 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-b6d81ee3-2aed-46bc-bb82-771d1506cee8-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Lock "cinder-b6d81ee3-2aed-46bc-bb82-771d1506cee8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-quobyte-b6d81ee3-2aed-46bc-bb82-771d1506cee8" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-b6d81ee3-2aed-46bc-bb82-771d1506cee8" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f32152b-6674-4f57-9657-0c0d70d040e1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:30 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3" returned: 0 in 0.543s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:30 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 Sep 29 12:13:30 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ceaca8a-f562-464e-b909-c145fdfe018a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d31b6d-3aeb-4603-ad6d-7df21ef2abd0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:30 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a Sep 29 12:13:30 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:30 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef 1073741824" returned: 0 in 0.579s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:30 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef Sep 29 12:13:30 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:30 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8" returned: 0 in 0.463s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:30 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8 Sep 29 12:13:30 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:30 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef" returned: 0 in 0.307s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc9a7b6-f6cf-476a-a3a3-18d9663ba594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e18db6e5-afb3-45d8-a022-435a2c967eef', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc4c74a-f311-4b7c-8fbc-d5c64b6c4d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Volume volume-e18db6e5-afb3-45d8-a022-435a2c967eef (e18db6e5-afb3-45d8-a022-435a2c967eef): created successfully Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc4c74a-f311-4b7c-8fbc-d5c64b6c4d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Flow 'volume_create_manager' (96dd578b-2874-46e1-907d-112d69e0e7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:31 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-b6d81ee3-2aed-46bc-bb82-771d1506cee8" returned: 0 in 0.299s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-82666e67-a41e-4e9f-a855-f3ecf21f0707 tempest-CinderUnicodeTest-2014901465 None] Created volume successfully. Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-b6d81ee3-2aed-46bc-bb82-771d1506cee8" released by "delete_volume" :: held 0.821s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:31 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a" returned: 0 in 0.622s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Created reservations ['4eabc47c-d3a2-46dc-81e5-21c0cdfaafdc', '4630ff83-e18d-48b3-8018-9cd2feec898f', 'e9a6cc5a-5f5b-4344-aa0d-594b60de0e1e', '78b7735d-96f9-4507-8450-4306679a260d'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:31 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 Sep 29 12:13:31 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:31 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:31 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:31 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.267s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Deleted volume successfully. Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6a73655c-7265-4100-9459-009f76c7086a tempest-ProjectReaderTests-721195502 None] Lock "cinder-b6d81ee3-2aed-46bc-bb82-771d1506cee8-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:31 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3" returned: 0 in 0.407s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:31 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3 Sep 29 12:13:31 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:31 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a.b6e0c297-256f-4eca-a20e-46f8f51a58c3" returned: 0 in 0.266s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-b6e0c297-256f-4eca-a20e-46f8f51a58c3" released by "_delete_snapshot" :: held 1.983s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-3ceaca8a-f562-464e-b909-c145fdfe018a" released by "delete_snapshot" :: held 2.031s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Created reservations ['c2f6f8f5-1127-461d-b479-8621738666c2', 'bb6066b5-bc94-4c89-982e-d5e4d5c60888', '1c4eba21-ad4d-4a87-8632-6469480b23e5', '1ec07c70-cbce-4ca4-8f0e-eeca9b5fa5d4'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (0f6b3e58-5c33-4d08-af60-394af4fd8250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d517edc-ca4d-4c5a-a04d-73d548cfc0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d517edc-ca4d-4c5a-a04d-73d548cfc0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829308161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566c8aa5-c5ce-4353-ba94-17a8770fe96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:32Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9a6ff2-3a07-4c78-bd60-d6cfef32f149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9a6ff2-3a07-4c78-bd60-d6cfef32f149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea55b30-829c-4ca9-ac8d-f88907864f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea55b30-829c-4ca9-ac8d-f88907864f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566c8aa5-c5ce-4353-ba94-17a8770fe96b', 'volume_name': 'volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb35cda-d768-4f3c-9a60-4da92181b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb35cda-d768-4f3c-9a60-4da92181b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228b91d9-1720-428f-8d4b-750d6ca46cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Volume 566c8aa5-c5ce-4353-ba94-17a8770fe96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b', 'volume_size': 1} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829308161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566c8aa5-c5ce-4353-ba94-17a8770fe96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:32Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Creating volume 566c8aa5-c5ce-4353-ba94-17a8770fe96b {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:32 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:32 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b 1073741824 Sep 29 12:13:32 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Delete snapshot completed successfully. Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8b75f6df-5c60-4f8b-8284-226a109de8f0 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-b6e0c297-256f-4eca-a20e-46f8f51a58c3-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:32 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b 1073741824" returned: 0 in 0.582s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:32 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b Sep 29 12:13:32 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Flow 'volume_create_manager' (e7d3fd04-982f-480f-830c-e34d467a3b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec73644d-821e-4efd-b6d5-243371293c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec73644d-821e-4efd-b6d5-243371293c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1408203083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86e54bb-25ff-4b16-81bd-ec9ef324bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492643ff55cb458a8e52c7d45aa46720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:33Z,use_quota=True,user_id='8d1ae24532bb4ce6ab0b3dab5b35ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cc2ad8-5dd4-4032-a324-4e1c48623c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cc2ad8-5dd4-4032-a324-4e1c48623c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1366bfb7-7abb-48e3-989a-70943f0e73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1366bfb7-7abb-48e3-989a-70943f0e73c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e86e54bb-25ff-4b16-81bd-ec9ef324bdc2', 'volume_name': 'volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86f7794-1037-4877-a036-8407bff0c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86f7794-1037-4877-a036-8407bff0c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06706955-ef94-402e-8356-78fee149008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Volume e86e54bb-25ff-4b16-81bd-ec9ef324bdc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2', 'volume_size': 1} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:32 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b" returned: 0 in 0.304s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1408203083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86e54bb-25ff-4b16-81bd-ec9ef324bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492643ff55cb458a8e52c7d45aa46720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:33Z,use_quota=True,user_id='8d1ae24532bb4ce6ab0b3dab5b35ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Creating volume e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:32 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228b91d9-1720-428f-8d4b-750d6ca46cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:32 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b537c181-6846-46f1-8231-382e5c96b01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:32 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 1073741824 Sep 29 12:13:32 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:33 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Volume volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b (566c8aa5-c5ce-4353-ba94-17a8770fe96b): created successfully Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b537c181-6846-46f1-8231-382e5c96b01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (0f6b3e58-5c33-4d08-af60-394af4fd8250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-81c8e34f-de0e-4986-a267-095090867895 tempest-ProjectReaderTests-721195502 None] Created volume successfully. Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-3ceaca8a-f562-464e-b909-c145fdfe018a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-3ceaca8a-f562-464e-b909-c145fdfe018a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-quobyte-3ceaca8a-f562-464e-b909-c145fdfe018a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-3ceaca8a-f562-464e-b909-c145fdfe018a" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0403d2-aec9-4a16-a907-8913d47cf636]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:33 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a Sep 29 12:13:33 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:33 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 1073741824" returned: 0 in 0.545s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:33 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 Sep 29 12:13:33 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:33 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a" returned: 0 in 0.459s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:33 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a Sep 29 12:13:33 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:33 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" returned: 0 in 0.259s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06706955-ef94-402e-8356-78fee149008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b653ab4-1cf7-4bae-86ba-55b7b2c5fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:33 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Volume volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 (e86e54bb-25ff-4b16-81bd-ec9ef324bdc2): created successfully Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b653ab4-1cf7-4bae-86ba-55b7b2c5fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Flow 'volume_create_manager' (e7d3fd04-982f-480f-830c-e34d467a3b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-bc2e94c6-a79e-496d-bdaa-d567c3f57a10 tempest-CinderUnicodeTest-2014901465 None] Created volume successfully. Sep 29 12:13:33 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3ceaca8a-f562-464e-b909-c145fdfe018a" returned: 0 in 0.310s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-3ceaca8a-f562-464e-b909-c145fdfe018a" released by "delete_volume" :: held 0.848s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-566c8aa5-c5ce-4353-ba94-17a8770fe96b-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Lock "cinder-566c8aa5-c5ce-4353-ba94-17a8770fe96b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Created reservations ['e0bf99e1-7ce6-4688-9e49-65c582603bd5', 'c1d12be4-9d5a-4cf8-8874-932275f17f48', '81701cf7-fae8-44a2-966f-a74c9d19e1f8', 'a08c2775-a0fe-4819-aeb9-04c6e108b22d'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-quobyte-566c8aa5-c5ce-4353-ba94-17a8770fe96b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-566c8aa5-c5ce-4353-ba94-17a8770fe96b" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[229824a6-0901-454b-8fad-a1b59e56a9c3]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:34 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:34 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-fc355b6f-7580-49d4-908a-c1c53cb86739-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:34 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b Sep 29 12:13:34 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-fc355b6f-7580-49d4-908a-c1c53cb86739-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "cinder-quobyte-fc355b6f-7580-49d4-908a-c1c53cb86739" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-fc355b6f-7580-49d4-908a-c1c53cb86739" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[be712a3a-3a96-426c-97d7-8313fc6d30be]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:34 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 Sep 29 12:13:34 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:34 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.345s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Deleted volume successfully. Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c8458121-dda7-47bc-8e18-a941b1306ce9 tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-3ceaca8a-f562-464e-b909-c145fdfe018a-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:34 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b" returned: 0 in 0.441s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:34 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b Sep 29 12:13:34 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:34 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739" returned: 0 in 0.441s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:34 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739 Sep 29 12:13:34 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:34 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-566c8aa5-c5ce-4353-ba94-17a8770fe96b" returned: 0 in 0.330s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-566c8aa5-c5ce-4353-ba94-17a8770fe96b" released by "delete_volume" :: held 0.847s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Created reservations ['19f6f799-5f90-4921-8cc6-901a98065473', '3c36c60c-e9fd-4fd5-bc6b-af597f4f6463', '19a7e378-9ae5-4ec9-b364-b952e4466cbc', '338677e0-1bc3-4859-8448-67e272fb2103'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:35 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:35 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Creating offline snapshot ce4756f2-a944-4c79-b5e0-cfc434790736 of volume e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:13:35 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-fc355b6f-7580-49d4-908a-c1c53cb86739" returned: 0 in 0.387s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef9e844-97af-411d-9a9b-ac2097de7128]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-quobyte-fc355b6f-7580-49d4-908a-c1c53cb86739" released by "delete_volume" :: held 0.903s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Created reservations ['33fa41f5-6f69-4824-bcb5-81c5fc0c39c2', '844136cb-5503-48ef-96d9-e1136e6e2e85', 'd60e26ba-d512-4379-b73a-cd748e3a1c40', 'f567788f-9fc0-4527-9134-cdd75265a9a5'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:35 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 Sep 29 12:13:35 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:35 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:35 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:35 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.409s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Deleted volume successfully. Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-cfc45288-461a-443f-8a39-dcd2eaa51d56 tempest-ProjectReaderTests-721195502 None] Lock "cinder-566c8aa5-c5ce-4353-ba94-17a8770fe96b-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:35 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.351s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:35 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Deleted volume successfully. Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" returned: 0 in 0.636s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1ed672e3-ee84-49a2-9f01-4a88d97d6e2b tempest-VolumeDependencyTests-1556572638 None] Lock "cinder-fc355b6f-7580-49d4-908a-c1c53cb86739-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:35 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 1G Sep 29 12:13:35 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:35 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (8f8ad403-582d-46eb-892a-ef4be3cff782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834c087b-f3fa-4dc6-b05f-9dd445f52b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834c087b-f3fa-4dc6-b05f-9dd445f52b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172474341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957bae55-32de-416c-8457-a9acbea3cd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:36Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143e1de3-577f-48b8-b759-ad363f7ce7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143e1de3-577f-48b8-b759-ad363f7ce7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785b3f3f-b4e5-4cdf-9e89-b20f721992de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785b3f3f-b4e5-4cdf-9e89-b20f721992de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957bae55-32de-416c-8457-a9acbea3cd83', 'volume_name': 'volume-957bae55-32de-416c-8457-a9acbea3cd83', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b21aa1-203e-4986-9583-6feddb6dca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b21aa1-203e-4986-9583-6feddb6dca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74021a7c-0777-43a4-90a6-bfe76dec5c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:36 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Volume 957bae55-32de-416c-8457-a9acbea3cd83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957bae55-32de-416c-8457-a9acbea3cd83', 'volume_size': 1} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:36 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 1G" returned: 0 in 0.505s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:36 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 Sep 29 12:13:36 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:36 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736" returned: 0 in 0.302s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:36 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 is being set with open permissions: ugo+rw Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:36 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 Sep 29 12:13:36 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:36 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736" returned: 0 in 0.268s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:37 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.info Sep 29 12:13:37 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:37 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.info" returned: 0 in 0.255s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:37 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.info is being set with open permissions: ugo+rw Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:37 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.info Sep 29 12:13:37 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:37 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.info" returned: 0 in 0.277s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172474341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957bae55-32de-416c-8457-a9acbea3cd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7d550289014bdbb465d3008fd64ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:36Z,use_quota=True,user_id='8c588c3f78c345edb602179a9edb65cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Creating volume 957bae55-32de-416c-8457-a9acbea3cd83 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:37 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:37 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 1073741824 Sep 29 12:13:37 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:37 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e010b118-9f12-4566-aab2-a70bbec35554 tempest-CinderUnicodeTest-2014901465 None] Create snapshot completed successfully Sep 29 12:13:38 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 1073741824" returned: 0 in 0.575s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:38 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 Sep 29 12:13:38 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "cinder-ce4756f2-a944-4c79-b5e0-cfc434790736-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-ce4756f2-a944-4c79-b5e0-cfc434790736-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "cinder-quobyte-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "cinder-quobyte-ce4756f2-a944-4c79-b5e0-cfc434790736" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-ce4756f2-a944-4c79-b5e0-cfc434790736" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Deleting offline snapshot ce4756f2-a944-4c79-b5e0-cfc434790736 of volume e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] snapshot_file for this snap is: volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9b8247-8461-4a98-9986-51b36f81e68c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:38 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83" returned: 0 in 0.401s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74021a7c-0777-43a4-90a6-bfe76dec5c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957bae55-32de-416c-8457-a9acbea3cd83', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e2f970-6461-48b0-bbd3-8a266a2c5e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:38 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Volume volume-957bae55-32de-416c-8457-a9acbea3cd83 (957bae55-32de-416c-8457-a9acbea3cd83): created successfully Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e2f970-6461-48b0-bbd3-8a266a2c5e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Flow 'volume_create_manager' (8f8ad403-582d-46eb-892a-ef4be3cff782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:38 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f310cf91-1b34-461b-b0f6-2cfe9653c00b tempest-ProjectReaderTests-721195502 None] Created volume successfully. Sep 29 12:13:38 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 Sep 29 12:13:38 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:39 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736" returned: 0 in 0.427s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccac92f7-7bff-4c77-998e-6aa944ab88df]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-957bae55-32de-416c-8457-a9acbea3cd83-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Lock "cinder-957bae55-32de-416c-8457-a9acbea3cd83-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Acquiring lock "cinder-quobyte-957bae55-32de-416c-8457-a9acbea3cd83" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:39 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 Sep 29 12:13:39 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-957bae55-32de-416c-8457-a9acbea3cd83" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad4c16-eb6a-40af-b171-6ad8560e9be1]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:39 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 Sep 29 12:13:39 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:39 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" returned: 0 in 0.434s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:39 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 Sep 29 12:13:39 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:39 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83" returned: 0 in 0.454s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:39 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83 Sep 29 12:13:39 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:39 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736" returned: 0 in 0.430s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:39 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736 Sep 29 12:13:39 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:40 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-957bae55-32de-416c-8457-a9acbea3cd83" returned: 0 in 0.323s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Lock "cinder-quobyte-957bae55-32de-416c-8457-a9acbea3cd83" released by "delete_volume" :: held 0.829s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Created reservations ['cd7a0473-fc2f-4da0-9859-46cc40f5aa71', '5f758c23-0da6-4486-97f6-cc472f8316c4', '9807fcc9-d77a-4b06-8538-f1a608a7090e', 'c6a0b2c0-2658-4bb9-b069-c77cc6d208c6'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:40 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:40 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:40 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2.ce4756f2-a944-4c79-b5e0-cfc434790736" returned: 0 in 0.336s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-ce4756f2-a944-4c79-b5e0-cfc434790736" released by "_delete_snapshot" :: held 1.826s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" released by "delete_snapshot" :: held 1.866s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Created reservations ['daeca4e4-8ead-4647-950e-0182a0893839', 'fa1a6bb8-afec-4c73-ba61-ab53364539cc', '798800fa-4695-4e91-8105-c4ecd9e4a31b', '280ca7ac-71b0-480b-a2cb-ef76efa626b1'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Delete snapshot completed successfully. Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-51d1f379-6fa3-4a5a-b68c-25f3c533b7d4 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-ce4756f2-a944-4c79-b5e0-cfc434790736-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:40 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.324s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:40 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Deleted volume successfully. Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-1cc232b4-c9be-42a7-ab81-d64e7f777371 tempest-ProjectReaderTests-721195502 None] Lock "cinder-957bae55-32de-416c-8457-a9acbea3cd83-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "cinder-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "cinder-quobyte-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" acquired by "delete_volume" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b2a974-7840-4c3e-a97b-22a03a396d92]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:41 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 Sep 29 12:13:41 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:41 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" returned: 0 in 0.390s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:41 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2 Sep 29 12:13:41 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:41 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" returned: 0 in 0.244s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2" released by "delete_volume" :: held 0.715s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=208,cinder:UPDATE=316,cinder:INSERT=84,cinder:DELETE=22 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Created reservations ['a171e591-bd89-41f4-9c3a-fd9d3d71ccf2', 'a24fffce-5941-4440-a881-14dfabd93e30', 'eade8678-0926-4538-8da4-6435f4014892', 'ba897ef8-a207-46f4-b077-f67c62369873'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:41 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:41 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "cinder-e18db6e5-afb3-45d8-a022-435a2c967eef-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-e18db6e5-afb3-45d8-a022-435a2c967eef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:UPDATE=307,cinder:SELECT=239,cinder:INSERT=80,cinder:DELETE=33 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "cinder-quobyte-e18db6e5-afb3-45d8-a022-435a2c967eef" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:42 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-e18db6e5-afb3-45d8-a022-435a2c967eef" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.442s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e231a05e-0f6d-45ea-900f-a63a58b5f655]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Deleted volume successfully. Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-8475b84f-9faa-4bd7-9085-16cd1e147a74 tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-e86e54bb-25ff-4b16-81bd-ec9ef324bdc2-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:42 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef Sep 29 12:13:42 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:42 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef" returned: 0 in 0.519s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:42 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef Sep 29 12:13:42 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:43 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e18db6e5-afb3-45d8-a022-435a2c967eef" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-quobyte-e18db6e5-afb3-45d8-a022-435a2c967eef" released by "delete_volume" :: held 0.926s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Created reservations ['7e56fa50-df83-4132-bd88-2952013c64e7', '297b0ace-92dd-4350-a807-124f072eeb36', '913734b9-c939-4be1-83d6-d39f88db9ac7', '6c8b42dd-5534-418b-bdfe-fd356a6ed107'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:43 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:43 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:43 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.328s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:43 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Deleted volume successfully. Sep 29 12:13:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-ae92cbc0-8bac-4c4b-b1c0-c5aed0bdbc8c tempest-CinderUnicodeTest-2014901465 None] Lock "cinder-e18db6e5-afb3-45d8-a022-435a2c967eef-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Flow 'volume_create_manager' (3e2a0d23-94ca-45b5-a24f-6cbe43556ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f74902-0e96-4cba-95b1-cba659c036d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f74902-0e96-4cba-95b1-cba659c036d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-958965324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4afa98a49403fb2dab72da79757c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:50Z,use_quota=True,user_id='6c786d1b911a4e4f99906d68b24d8ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45d278b-efe7-49bf-92b3-559663c196ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45d278b-efe7-49bf-92b3-559663c196ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee5dbc-c94e-4d67-91b4-93ce2ffb7ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee5dbc-c94e-4d67-91b4-93ce2ffb7ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0', 'volume_name': 'volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01192fd-05df-4566-ab4d-0769a306e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01192fd-05df-4566-ab4d-0769a306e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41769d3d-e71b-423f-807a-0961a3a3d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:50 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Volume dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0', 'volume_size': 1} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-958965324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4afa98a49403fb2dab72da79757c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:50Z,use_quota=True,user_id='6c786d1b911a4e4f99906d68b24d8ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Creating volume dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:50 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:50 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 1073741824 Sep 29 12:13:50 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:51 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 1073741824" returned: 0 in 0.573s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:51 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 Sep 29 12:13:51 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:51 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0" returned: 0 in 0.274s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41769d3d-e71b-423f-807a-0961a3a3d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fec0f6-4f29-4adc-a7aa-5aae13a7e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:51 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Volume volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 (dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0): created successfully Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fec0f6-4f29-4adc-a7aa-5aae13a7e71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:51 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Flow 'volume_create_manager' (3e2a0d23-94ca-45b5-a24f-6cbe43556ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c21f0b9c-30d4-4d2e-98a6-9829e725ba27 tempest-ProjectReaderTests-1503233483 None] Created volume successfully. Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Acquiring lock "cinder-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Lock "cinder-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Acquiring lock "cinder-quobyte-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Lock "cinder-quobyte-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9252bee-2c61-4541-a7d7-98bd6bce0c6a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:53 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 Sep 29 12:13:53 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (e2546f1e-a635-41e4-934a-fdb82ae75226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:53 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3cdcfe-5a7d-4ef4-9682-b40c33f92f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3cdcfe-5a7d-4ef4-9682-b40c33f92f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854003217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efe8ae7-0f11-4e73-9765-f850b4d7878c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:54Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:53 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0 Sep 29 12:13:53 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b8eec1-c863-42e0-aaaa-e9e7a5c94a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b8eec1-c863-42e0-aaaa-e9e7a5c94a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dd9bd4-af87-430f-af83-5fc5a85674f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dd9bd4-af87-430f-af83-5fc5a85674f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3efe8ae7-0f11-4e73-9765-f850b4d7878c', 'volume_name': 'volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2e2f8-2e41-496f-9660-c05dfbf00cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2e2f8-2e41-496f-9660-c05dfbf00cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161010e9-e01a-4067-a176-a2efbfb0fc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Volume 3efe8ae7-0f11-4e73-9765-f850b4d7878c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c', 'volume_size': 1} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854003217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efe8ae7-0f11-4e73-9765-f850b4d7878c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:54Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Creating volume 3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:53 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:53 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c 1073741824 Sep 29 12:13:53 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:53 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0" returned: 0 in 0.279s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:53 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Lock "cinder-quobyte-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0" released by "delete_volume" :: held 0.786s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Created reservations ['a0093856-bcb8-48fd-a658-9a378aa86433', '7f92c92a-07b7-4d96-ae83-728b43e493e6', '2400a1a2-a861-4a87-913d-ba90763d511e', '8abd664a-f6de-45e5-917a-fa9474baddd1'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:54 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:54 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:54 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c 1073741824" returned: 0 in 0.608s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:54 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.313s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:54 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c Sep 29 12:13:54 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:54 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Deleted volume successfully. Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b1c883a3-8cc6-4b84-bfd4-0da1cff55d3b tempest-ProjectReaderTests-1503233483 None] Lock "cinder-dc88d96e-f43a-4e1a-bfbc-3f0402d8c0e0-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:54 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c" returned: 0 in 0.310s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161010e9-e01a-4067-a176-a2efbfb0fc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af492b44-38a5-40e0-980a-2c9e181e1889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:54 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Volume volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c (3efe8ae7-0f11-4e73-9765-f850b4d7878c): created successfully Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af492b44-38a5-40e0-980a-2c9e181e1889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (e2546f1e-a635-41e4-934a-fdb82ae75226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:54 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-060ee505-b53d-45a8-96e6-16bf05e9948a tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Flow 'volume_create_manager' (276fb5f4-3b7b-48d4-b7cf-8eed0bed12f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288c5d66-9ef1-4170-a60b-8e481f314e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288c5d66-9ef1-4170-a60b-8e481f314e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500113846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1107edd-899c-4b88-b7de-fcefda977f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4afa98a49403fb2dab72da79757c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:55Z,use_quota=True,user_id='6c786d1b911a4e4f99906d68b24d8ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1753c4fc-ddae-4203-8cfe-2b2121348be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1753c4fc-ddae-4203-8cfe-2b2121348be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347bb6bf-876e-4ce0-bc43-def277524a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347bb6bf-876e-4ce0-bc43-def277524a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1107edd-899c-4b88-b7de-fcefda977f95', 'volume_name': 'volume-e1107edd-899c-4b88-b7de-fcefda977f95', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1890dbef-6f3b-4094-9775-68e8b0c8d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1890dbef-6f3b-4094-9775-68e8b0c8d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5d6141-25c3-4185-a768-321a9bcd75e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:54 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Volume e1107edd-899c-4b88-b7de-fcefda977f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1107edd-899c-4b88-b7de-fcefda977f95', 'volume_size': 1} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500113846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1107edd-899c-4b88-b7de-fcefda977f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed4afa98a49403fb2dab72da79757c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:13:55Z,use_quota=True,user_id='6c786d1b911a4e4f99906d68b24d8ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Creating volume e1107edd-899c-4b88-b7de-fcefda977f95 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:13:54 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:13:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:54 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 1073741824 Sep 29 12:13:54 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:55 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 1073741824" returned: 0 in 0.452s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:55 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 Sep 29 12:13:55 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:55 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5d6141-25c3-4185-a768-321a9bcd75e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1107edd-899c-4b88-b7de-fcefda977f95', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed0b657-9aaf-4246-a1a9-c024b7b22129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:13:55 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Volume volume-e1107edd-899c-4b88-b7de-fcefda977f95 (e1107edd-899c-4b88-b7de-fcefda977f95): created successfully Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed0b657-9aaf-4246-a1a9-c024b7b22129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:13:55 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Flow 'volume_create_manager' (276fb5f4-3b7b-48d4-b7cf-8eed0bed12f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:13:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7d642f30-4ed5-4489-ae2a-660055c04303 tempest-ProjectReaderTests-1503233483 None] Created volume successfully. Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot c2b96230-b794-49c5-8aab-ee0450da26f7 of volume 3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[df48d9aa-b7a3-4b37-ab4a-aa83bea3f33e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:56 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c Sep 29 12:13:56 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:56 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c" returned: 0 in 0.401s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:56 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 1G Sep 29 12:13:56 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Acquiring lock "cinder-e1107edd-899c-4b88-b7de-fcefda977f95-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Lock "cinder-e1107edd-899c-4b88-b7de-fcefda977f95-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Acquiring lock "cinder-quobyte-e1107edd-899c-4b88-b7de-fcefda977f95" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Lock "cinder-quobyte-e1107edd-899c-4b88-b7de-fcefda977f95" acquired by "delete_volume" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3961b0f1-9c0a-4a2f-b209-dbc3f9a3b5ca]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:57 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 1G" returned: 0 in 0.528s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:57 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 Sep 29 12:13:57 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:57 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 Sep 29 12:13:57 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:57 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7" returned: 0 in 0.313s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:57 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 is being set with open permissions: ugo+rw Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:57 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:57 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95" returned: 0 in 0.400s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:57 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:57 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95 Sep 29 12:13:57 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:57 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7" returned: 0 in 0.246s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:57 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e1107edd-899c-4b88-b7de-fcefda977f95" returned: 0 in 0.251s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Lock "cinder-quobyte-e1107edd-899c-4b88-b7de-fcefda977f95" released by "delete_volume" :: held 0.712s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:57 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.info Sep 29 12:13:57 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Created reservations ['1ed5ed40-c5ef-4ed4-ac0b-f9451979311e', '5b38bfe2-75b8-402d-9e3b-dd08c6eb99e3', '440aa493-e72a-4831-ad9d-41aed76bd471', '6a71f642-51fd-4963-a82a-7275273943bd'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:57 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:13:57 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:58 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.info" returned: 0 in 0.290s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:58 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.info is being set with open permissions: ugo+rw Sep 29 12:13:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:58 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.info Sep 29 12:13:58 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:58 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.323s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:58 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:13:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Deleted volume successfully. Sep 29 12:13:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-35046f57-9a43-4eb9-ba99-ef41d8e1df80 tempest-ProjectReaderTests-1503233483 None] Lock "cinder-e1107edd-899c-4b88-b7de-fcefda977f95-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:13:58 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.info" returned: 0 in 0.348s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:13:58 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5fb5c294-3d0c-48da-9dd8-cfa85694cc40 tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-c2b96230-b794-49c5-8aab-ee0450da26f7-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Lock "cinder-c2b96230-b794-49c5-8aab-ee0450da26f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-3efe8ae7-0f11-4e73-9765-f850b4d7878c" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-3efe8ae7-0f11-4e73-9765-f850b4d7878c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-c2b96230-b794-49c5-8aab-ee0450da26f7" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-c2b96230-b794-49c5-8aab-ee0450da26f7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot c2b96230-b794-49c5-8aab-ee0450da26f7 of volume 3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa1a263-a5f4-4aa4-ba64-c47a762039bf]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:13:59 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 Sep 29 12:13:59 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:13:59 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7" returned: 0 in 0.447s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[93be6eb2-d126-45ec-8c5f-9956ab2c5e19]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:13:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:00 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c Sep 29 12:14:00 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:00 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c" returned: 0 in 0.427s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:00 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 Sep 29 12:14:00 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:00 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7" returned: 0 in 0.376s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:00 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7 Sep 29 12:14:00 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:01 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c.c2b96230-b794-49c5-8aab-ee0450da26f7" returned: 0 in 0.288s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-c2b96230-b794-49c5-8aab-ee0450da26f7" released by "_delete_snapshot" :: held 1.673s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-3efe8ae7-0f11-4e73-9765-f850b4d7878c" released by "delete_snapshot" :: held 1.705s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Created reservations ['f3bc55a5-d3d2-4e03-bf1c-0b73d96c21fc', 'af65bd10-857c-4fd1-98dc-e474c426c3bc', '2c7edbe6-0ba5-4c16-9025-161aba0cdf7f', 'e8890c4c-6747-49ef-b159-887f2e1cdd7b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:01 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-dac72a10-53e2-46ff-aac6-32eaa545bf4e tempest-ProjectMemberTests-1935556730 None] Lock "cinder-c2b96230-b794-49c5-8aab-ee0450da26f7-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-3efe8ae7-0f11-4e73-9765-f850b4d7878c-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Lock "cinder-3efe8ae7-0f11-4e73-9765-f850b4d7878c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-3efe8ae7-0f11-4e73-9765-f850b4d7878c" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-3efe8ae7-0f11-4e73-9765-f850b4d7878c" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[429434a6-149d-4b0d-b1e5-362217f2eefb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:01 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c Sep 29 12:14:01 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:02 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c" returned: 0 in 0.377s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:02 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c Sep 29 12:14:02 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:02 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-3efe8ae7-0f11-4e73-9765-f850b4d7878c" returned: 0 in 0.272s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-3efe8ae7-0f11-4e73-9765-f850b4d7878c" released by "delete_volume" :: held 0.723s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Created reservations ['86098f9f-e565-42a3-88f6-4c92ab99b356', '8b1b6139-918d-4784-aa3f-bc131fbc9664', '3f19b94a-3922-4560-adfa-aae59f72369c', '49836720-246c-4b38-a8d6-0d7d91848b3a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:02 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:02 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:02 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.274s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:14:02 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-3bedd573-710a-47ec-abed-2002d4544bfa tempest-ProjectMemberTests-1935556730 None] Lock "cinder-3efe8ae7-0f11-4e73-9765-f850b4d7878c-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (d70b0e1d-5ea4-46d1-92e0-d6db5ea2cd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc1505a-8997-4b91-9904-4a6d67e84e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc1505a-8997-4b91-9904-4a6d67e84e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998796267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01be942b-e941-4ee8-8326-f3bcdce0eb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:03Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bffa277-8f12-4cc2-b5c3-b33c46c4c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bffa277-8f12-4cc2-b5c3-b33c46c4c33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cd481b-019d-4083-8dc6-49080eaf9f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cd481b-019d-4083-8dc6-49080eaf9f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01be942b-e941-4ee8-8326-f3bcdce0eb54', 'volume_name': 'volume-01be942b-e941-4ee8-8326-f3bcdce0eb54', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df159be-ff1b-49b3-b519-2429cddc724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df159be-ff1b-49b3-b519-2429cddc724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6302e894-05a3-40a9-b11b-1f2f4b6e8bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:03 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Volume 01be942b-e941-4ee8-8326-f3bcdce0eb54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01be942b-e941-4ee8-8326-f3bcdce0eb54', 'volume_size': 1} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998796267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01be942b-e941-4ee8-8326-f3bcdce0eb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:03Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Creating volume 01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:03 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:03 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 1073741824 Sep 29 12:14:03 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:03 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 1073741824" returned: 0 in 0.540s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:04 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 Sep 29 12:14:04 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:04 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54" returned: 0 in 0.328s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6302e894-05a3-40a9-b11b-1f2f4b6e8bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01be942b-e941-4ee8-8326-f3bcdce0eb54', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716ead3a-10f6-430d-b153-7bb995930e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:04 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Volume volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 (01be942b-e941-4ee8-8326-f3bcdce0eb54): created successfully Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716ead3a-10f6-430d-b153-7bb995930e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:04 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (d70b0e1d-5ea4-46d1-92e0-d6db5ea2cd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:04 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6c8d1b53-6111-4e3f-99f0-a686846eac12 tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:14:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:05 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot 3ef47cb8-8fdf-4577-b011-efe3f6880947 of volume 01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:14:05 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d190fed9-b0b6-4aee-b294-e8cc52672fd7]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:05 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 Sep 29 12:14:05 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:05 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54" returned: 0 in 0.399s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:06 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 1G Sep 29 12:14:06 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:06 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 1G" returned: 0 in 0.422s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:06 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 Sep 29 12:14:06 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:06 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947" returned: 0 in 0.318s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:06 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 is being set with open permissions: ugo+rw Sep 29 12:14:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:06 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 Sep 29 12:14:06 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:06 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947" returned: 0 in 0.245s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:07 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.info Sep 29 12:14:07 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:07 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.info" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:07 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.info is being set with open permissions: ugo+rw Sep 29 12:14:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:07 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.info Sep 29 12:14:07 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:07 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.info" returned: 0 in 0.254s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cac16588-5fb0-4a36-adec-3c393f14aebe tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-3ef47cb8-8fdf-4577-b011-efe3f6880947-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-3ef47cb8-8fdf-4577-b011-efe3f6880947-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-01be942b-e941-4ee8-8326-f3bcdce0eb54" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-01be942b-e941-4ee8-8326-f3bcdce0eb54" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-3ef47cb8-8fdf-4577-b011-efe3f6880947" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-3ef47cb8-8fdf-4577-b011-efe3f6880947" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot 3ef47cb8-8fdf-4577-b011-efe3f6880947 of volume 01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312f981-3059-4d5e-8400-f8cc3089fe65]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:08 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 Sep 29 12:14:08 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:09 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947" returned: 0 in 0.376s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01be942b-e941-4ee8-8326-f3bcdce0eb54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df4e992-b734-4dc1-8de6-f23241699bac]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:09 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 Sep 29 12:14:09 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:09 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54" returned: 0 in 0.382s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:09 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 Sep 29 12:14:09 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:09 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947" returned: 0 in 0.398s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:10 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947 Sep 29 12:14:10 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:10 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54.3ef47cb8-8fdf-4577-b011-efe3f6880947" returned: 0 in 0.271s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-3ef47cb8-8fdf-4577-b011-efe3f6880947" released by "_delete_snapshot" :: held 1.551s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-01be942b-e941-4ee8-8326-f3bcdce0eb54" released by "delete_snapshot" :: held 1.577s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:10 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Created reservations ['787f3764-4d18-4ab4-8825-b10018d5cc30', 'cb1db078-71f0-4447-96ac-9cd53b1ae191', '2b2bd860-9a83-40d4-9317-2c5d0f1250fe', 'd6eef637-2bcc-4302-86e4-c719c35851b4'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:10 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:14:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-b78a4ed0-807a-408b-81f6-97ffd106574b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-3ef47cb8-8fdf-4577-b011-efe3f6880947-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-01be942b-e941-4ee8-8326-f3bcdce0eb54-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-01be942b-e941-4ee8-8326-f3bcdce0eb54-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-01be942b-e941-4ee8-8326-f3bcdce0eb54" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-01be942b-e941-4ee8-8326-f3bcdce0eb54" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ecc8f-7a2e-429b-bbd4-d75ad03a5d40]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:11 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 Sep 29 12:14:11 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:11 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54" returned: 0 in 0.380s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:11 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54 Sep 29 12:14:11 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:11 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-01be942b-e941-4ee8-8326-f3bcdce0eb54" returned: 0 in 0.253s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-01be942b-e941-4ee8-8326-f3bcdce0eb54" released by "delete_volume" :: held 0.713s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Created reservations ['13888296-a0dc-484d-8018-1678ae97225b', '1a67cccd-ac1a-4361-9b64-3dbfc9edf525', '07497a5a-094f-473e-bdeb-05d3d7594b53', '5a714d7f-c6f5-4c89-a415-37af5f675687'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:11 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:11 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:12 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:12 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:12 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.357s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:12 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-2c423539-50fc-4f5b-8e5b-9d920a9da943 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-01be942b-e941-4ee8-8326-f3bcdce0eb54-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:12 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.359s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (6a782d52-12e0-4ebb-a514-7a25e218e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba159fd-efa3-4c4b-ba7e-602b35e136e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba159fd-efa3-4c4b-ba7e-602b35e136e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068805789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:13Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0639d4db-3106-4030-bba5-894b037c1c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0639d4db-3106-4030-bba5-894b037c1c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6407c4-3c67-4f6d-8745-4c5c21960be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6407c4-3c67-4f6d-8745-4c5c21960be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5', 'volume_name': 'volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b47e6f9-2671-4c8b-a05f-45a2e4e18f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b47e6f9-2671-4c8b-a05f-45a2e4e18f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ae2b7b-6bb5-4a86-989c-c9b50ef59e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:12 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Volume cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5', 'volume_size': 1} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068805789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:13Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Creating volume cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:12 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:12 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 1073741824 Sep 29 12:14:12 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:13 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 1073741824" returned: 0 in 0.570s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:13 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 Sep 29 12:14:13 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:13 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" returned: 0 in 0.325s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ae2b7b-6bb5-4a86-989c-c9b50ef59e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31837dd8-ff22-4387-9fa4-78bbc6a71ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:13 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Volume volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 (cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5): created successfully Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31837dd8-ff22-4387-9fa4-78bbc6a71ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:13 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (6a782d52-12e0-4ebb-a514-7a25e218e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c026399b-a9d3-435c-92ff-25e2ad031918 tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:14:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:15 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot d36939b0-d7ae-4516-aeb6-457c68eb6ed4 of volume cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:14:15 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bc8561-303d-4fd8-b5b7-0402d9b8e09d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:15 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 Sep 29 12:14:15 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:15 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" returned: 0 in 0.439s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:15 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:15 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 1G Sep 29 12:14:15 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:16 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 1G" returned: 0 in 0.545s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:16 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 Sep 29 12:14:16 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:16 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4" returned: 0 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:16 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 is being set with open permissions: ugo+rw Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:16 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 Sep 29 12:14:16 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:16 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4" returned: 0 in 0.267s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:16 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.info Sep 29 12:14:16 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Flow 'volume_create_manager' (3b84c587-de0b-4e7b-b20d-b2db6459cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1014e8e0-6c23-4ce6-bfe4-0e3c010f2b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1014e8e0-6c23-4ce6-bfe4-0e3c010f2b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-343637366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9789c9-4242-4ac0-a8a4-0fc1723fb02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857741a3ad8e4394ac7d2c10dcccaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:17Z,use_quota=True,user_id='97a43bea6ab749aa872ce73b51db0834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2a4800-fbab-469d-beda-bab27a55db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2a4800-fbab-469d-beda-bab27a55db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f966e6-1d82-4ff6-9b53-848fe4f655f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f966e6-1d82-4ff6-9b53-848fe4f655f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9789c9-4242-4ac0-a8a4-0fc1723fb02b', 'volume_name': 'volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf632bcf-acbd-4d0a-9cac-aa4a3fbc9965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf632bcf-acbd-4d0a-9cac-aa4a3fbc9965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93862beb-9d73-4d37-99d4-2f1700af97f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:16 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Volume ea9789c9-4242-4ac0-a8a4-0fc1723fb02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b', 'volume_size': 1} Sep 29 12:14:16 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:17 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.info" returned: 0 in 0.289s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:17 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.info is being set with open permissions: ugo+rw Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:17 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.info Sep 29 12:14:17 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:17 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.info" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-343637366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9789c9-4242-4ac0-a8a4-0fc1723fb02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857741a3ad8e4394ac7d2c10dcccaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:17Z,use_quota=True,user_id='97a43bea6ab749aa872ce73b51db0834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Creating volume ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:17 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:17 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b 1073741824 Sep 29 12:14:17 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9046b18c-1f55-45de-8f29-9fc030d75168 tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:14:17 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b 1073741824" returned: 0 in 0.416s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:17 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b Sep 29 12:14:17 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:17 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" returned: 0 in 0.253s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93862beb-9d73-4d37-99d4-2f1700af97f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44d82cf-d74b-4a4d-9d81-570cf174bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:18 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Volume volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b (ea9789c9-4242-4ac0-a8a4-0fc1723fb02b): created successfully Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44d82cf-d74b-4a4d-9d81-570cf174bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Flow 'volume_create_manager' (3b84c587-de0b-4e7b-b20d-b2db6459cc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:18 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d11413c8-39f4-4cf3-b8e4-5a4c05002ab0 tempest-SnapshotDependencyTests-6746670 None] Created volume successfully. Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-d36939b0-d7ae-4516-aeb6-457c68eb6ed4-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-d36939b0-d7ae-4516-aeb6-457c68eb6ed4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-d36939b0-d7ae-4516-aeb6-457c68eb6ed4" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-d36939b0-d7ae-4516-aeb6-457c68eb6ed4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot d36939b0-d7ae-4516-aeb6-457c68eb6ed4 of volume cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ce558-c97e-4bfd-ac1a-d48c23638d55]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:18 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 Sep 29 12:14:18 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:18 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4" returned: 0 in 0.359s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1baf9-5c21-40b2-8b2a-70e708b0d11d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:18 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 Sep 29 12:14:18 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Creating offline snapshot 3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f of volume ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:14:19 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" returned: 0 in 0.415s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ebc423-8e42-46b9-96e1-3cd386249a87]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:19 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 Sep 29 12:14:19 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:19 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b Sep 29 12:14:19 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:19 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4" returned: 0 in 0.344s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:19 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4 Sep 29 12:14:19 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:19 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" returned: 0 in 0.417s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:19 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f 1G Sep 29 12:14:19 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:19 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5.d36939b0-d7ae-4516-aeb6-457c68eb6ed4" returned: 0 in 0.266s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-d36939b0-d7ae-4516-aeb6-457c68eb6ed4" released by "_delete_snapshot" :: held 1.492s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" released by "delete_snapshot" :: held 1.519s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Created reservations ['cbdb7567-d270-48fd-955f-102702bd4882', '75e38ad9-b365-483a-9da7-c2f513b70f66', 'a32046b7-1dc7-4892-adf7-d91f92b953f6', '0ab05216-5044-4fa3-af41-75a29954b947'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:19 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-6bec86e8-9e7e-4acc-8eb3-eba9f2b95d14 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-d36939b0-d7ae-4516-aeb6-457c68eb6ed4-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:19 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f 1G" returned: 0 in 0.433s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:19 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f Sep 29 12:14:19 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:20 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" returned: 0 in 0.335s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:20 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f is being set with open permissions: ugo+rw Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:20 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f Sep 29 12:14:20 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f36f38e-a455-47a9-a8d7-d9a16ed58409]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:20 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" returned: 0 in 0.267s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:20 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 Sep 29 12:14:20 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:20 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.info Sep 29 12:14:20 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:20 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" returned: 0 in 0.385s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:20 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.info" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:20 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.info is being set with open permissions: ugo+rw Sep 29 12:14:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:20 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5 Sep 29 12:14:20 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:20 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.info Sep 29 12:14:20 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:21 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" returned: 0 in 0.282s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:21 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5" released by "delete_volume" :: held 0.730s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.info" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-73d22e99-c60f-402b-93d3-c72dc1691f28 tempest-SnapshotDependencyTests-6746670 None] Create snapshot completed successfully Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Created reservations ['a2c69c93-226a-4638-9dd4-085431628ab1', 'c05ef59a-af8e-439b-916a-5575a446b2ad', 'b51f80b6-0f98-4981-bcde-34b4d4549bf4', 'ac60985d-109d-429c-baf3-34d0e003fc43'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:21 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:21 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:21 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.261s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f667440e-994e-4f5d-8adf-3d6c0c177659 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-cf261b75-f4c1-4ec6-9b38-be6e7b5c33d5-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (c2b13327-a62c-4df2-8d2a-9ee6bea1669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:21 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa6fbbf-c6d5-436b-a649-bd14d1ce11ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa6fbbf-c6d5-436b-a649-bd14d1ce11ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217465954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4609e-846a-47a6-9311-777ec0421d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:22Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bea1a66-fd41-4c6f-a755-5e03fba08f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bea1a66-fd41-4c6f-a755-5e03fba08f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13725383-80de-4e5c-9f0a-9d321dfd1fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13725383-80de-4e5c-9f0a-9d321dfd1fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b4609e-846a-47a6-9311-777ec0421d7c', 'volume_name': 'volume-19b4609e-846a-47a6-9311-777ec0421d7c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dae261-47c1-4737-97a2-7ca760d9392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dae261-47c1-4737-97a2-7ca760d9392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c0e115-4e23-4714-9a91-8967580a032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Volume 19b4609e-846a-47a6-9311-777ec0421d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b4609e-846a-47a6-9311-777ec0421d7c', 'volume_size': 1} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217465954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4609e-846a-47a6-9311-777ec0421d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:22Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Creating volume 19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:22 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:22 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c 1073741824 Sep 29 12:14:22 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:22 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c 1073741824" returned: 0 in 0.441s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:22 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c Sep 29 12:14:22 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:22 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c" returned: 0 in 0.285s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c0e115-4e23-4714-9a91-8967580a032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b4609e-846a-47a6-9311-777ec0421d7c', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7decb6-050a-4465-b8d5-f64e0f04ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Volume volume-19b4609e-846a-47a6-9311-777ec0421d7c (19b4609e-846a-47a6-9311-777ec0421d7c): created successfully Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7decb6-050a-4465-b8d5-f64e0f04ef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (c2b13327-a62c-4df2-8d2a-9ee6bea1669a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Flow 'volume_create_manager' (65a32dc7-bb98-4de0-b30e-7e513df0fe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a9d205-2dc5-42e6-bf9b-e68d6f195647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5e3965ed-152d-46a3-bc78-6fa542bb0f4b tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a9d205-2dc5-42e6-bf9b-e68d6f195647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79de1fc-f01a-4947-9ef6-c5e3e14d54b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857741a3ad8e4394ac7d2c10dcccaf25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:23Z,use_quota=True,user_id='97a43bea6ab749aa872ce73b51db0834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e215bd-1a7e-4508-9a7b-3b778ccf8264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e215bd-1a7e-4508-9a7b-3b778ccf8264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937df3b6-4800-476c-96ab-2a3273673e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937df3b6-4800-476c-96ab-2a3273673e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c79de1fc-f01a-4947-9ef6-c5e3e14d54b7', 'volume_name': 'volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7', 'volume_size': 1, 'snapshot_id': '3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a1fd31-7fbf-4eed-8e3e-a3977685c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a1fd31-7fbf-4eed-8e3e-a3977685c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cfbeb6-8f43-4dbb-833c-8aa70567ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:22 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Volume c79de1fc-f01a-4947-9ef6-c5e3e14d54b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7', 'volume_size': 1, 'snapshot_id': '3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f'} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-quobyte-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" by "_create_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Creating volume c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 from snapshot 3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-quobyte-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" by "_copy_volume_from_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] snapshot: 3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f, volume: c79de1fc-f01a-4947-9ef6-c5e3e14d54b7, {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[732c1192-9353-4a94-93fe-49d3c87aa445]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:23 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f Sep 29 12:14:23 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:23 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" returned: 0 in 0.372s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb32cff-86a3-4e6f-b837-128e7a777978]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:23 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b Sep 29 12:14:23 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:23 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" returned: 0 in 0.384s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Creating direct copy from snapshot {{(pid=86117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG cinder.utils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Path /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 not found in is_blk_device check {{(pid=86117) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 12:14:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:23 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 Sep 29 12:14:23 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:29 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" returned: 0 in 5.864s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:29 devstack cinder-volume[86117]: DEBUG cinder.image.image_utils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 {{(pid=86117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 12:14:29 devstack cinder-volume[86117]: INFO cinder.image.image_utils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Converted 1024.00 MB image at 174.59 MB/s Sep 29 12:14:29 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 is being set with open permissions: ugo+rw Sep 29 12:14:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:29 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 Sep 29 12:14:29 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:29 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" returned: 0 in 0.233s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" released by "_copy_volume_from_snapshot" :: held 6.939s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" released by "_create_volume_from_snapshot" :: held 7.007s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.024s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.838s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot 805d3a59-42de-439a-a089-ec805d1950a8 of volume 19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cfbeb6-8f43-4dbb-833c-8aa70567ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7', 'volume_size': 1, 'snapshot_id': '3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f'}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c94043-0666-4e52-85a7-c36f1e6d35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d72a72-4519-4634-ba64-219f01dce136]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:30 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Volume volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 (c79de1fc-f01a-4947-9ef6-c5e3e14d54b7): created successfully Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c94043-0666-4e52-85a7-c36f1e6d35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Flow 'volume_create_manager' (65a32dc7-bb98-4de0-b30e-7e513df0fe63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:30 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5174db17-81ca-4cfb-8be8-ebb29f8f9576 tempest-SnapshotDependencyTests-6746670 None] Created volume successfully. Sep 29 12:14:30 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c Sep 29 12:14:30 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:30 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c" returned: 0 in 0.356s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:30 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 1G Sep 29 12:14:30 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-quobyte-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-quobyte-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Deleting offline snapshot 3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f of volume ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] snapshot_file for this snap is: volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[400acb68-1570-4f84-83fb-1679d19a274c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:30 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f Sep 29 12:14:30 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:30 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 1G" returned: 0 in 0.406s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19b4609e-846a-47a6-9311-777ec0421d7c -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:30 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19b4609e-846a-47a6-9311-777ec0421d7c -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 Sep 29 12:14:30 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:30 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" returned: 0 in 0.363s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a4a4f-0848-4a6b-b554-0c5a5b7dfd89]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:31 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b Sep 29 12:14:31 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:31 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19b4609e-846a-47a6-9311-777ec0421d7c -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8" returned: 0 in 0.282s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:31 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 is being set with open permissions: ugo+rw Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:31 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 Sep 29 12:14:31 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:31 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:31 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.info Sep 29 12:14:31 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:31 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" returned: 0 in 0.521s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:31 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f Sep 29 12:14:31 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:31 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.info" returned: 0 in 0.263s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:31 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.info is being set with open permissions: ugo+rw Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:31 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.info Sep 29 12:14:31 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:31 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" returned: 0 in 0.321s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:31 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f Sep 29 12:14:31 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:31 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.info" returned: 0 in 0.274s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-85667ac3-b8b2-4d4b-8f4c-5efd04b038ed tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:14:32 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b.3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" returned: 0 in 0.266s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f" released by "_delete_snapshot" :: held 1.567s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" released by "delete_snapshot" :: held 1.589s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Created reservations ['3dff1cf6-09fc-4ce8-abdd-7157bd683322', 'b31bab42-2a16-4221-9757-d2052095d13e', '975fea0d-ee4d-48e4-9731-4539f0284cd4', 'cd776fb5-dd37-417c-ad6e-c4c6bd171327'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:32 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Delete snapshot completed successfully. Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-20f94cc4-95ee-4fc6-8e87-5eaf3c3c048e tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-3fe5ab0a-cde9-456c-a37f-40cc6fb6d68f-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-805d3a59-42de-439a-a089-ec805d1950a8-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-805d3a59-42de-439a-a089-ec805d1950a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-19b4609e-846a-47a6-9311-777ec0421d7c" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-19b4609e-846a-47a6-9311-777ec0421d7c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-805d3a59-42de-439a-a089-ec805d1950a8" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-805d3a59-42de-439a-a089-ec805d1950a8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot 805d3a59-42de-439a-a089-ec805d1950a8 of volume 19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-quobyte-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa1ed63-9baa-45c7-8431-f1305b652d19]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" acquired by "delete_volume" :: waited 0.031s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4139d5-38aa-4eec-a071-30038e499497]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:32 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 Sep 29 12:14:32 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:32 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b Sep 29 12:14:32 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:33 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19b4609e-846a-47a6-9311-777ec0421d7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c004218a-03b4-49cf-94e9-cd8fdf9a67f0]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:33 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" returned: 0 in 0.383s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:33 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b Sep 29 12:14:33 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:33 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c Sep 29 12:14:33 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:33 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b" released by "delete_volume" :: held 0.691s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Created reservations ['49318969-b12e-419d-b043-2fb7930ae7fd', '005a1589-4671-4d14-bfc5-1550b212d3dd', 'a2a990d6-75c9-4b1f-811e-589ce09bea56', '77d73e30-f28e-4681-bcad-154b50dc1769'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:33 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c" returned: 0 in 0.375s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:33 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 Sep 29 12:14:33 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:33 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:33 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:33 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.266s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:33 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Deleted volume successfully. Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "cinder-quobyte-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f50c712a-8e92-4455-95da-a19fea4dfe73 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-ea9789c9-4242-4ac0-a8a4-0fc1723fb02b-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:33 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55ead8-c86a-4d30-ae95-d7c893e78c02]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:33 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8 Sep 29 12:14:33 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:34 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 Sep 29 12:14:34 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:34 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c.805d3a59-42de-439a-a089-ec805d1950a8" returned: 0 in 0.258s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-805d3a59-42de-439a-a089-ec805d1950a8" released by "_delete_snapshot" :: held 1.503s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-19b4609e-846a-47a6-9311-777ec0421d7c" released by "delete_snapshot" :: held 1.535s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Created reservations ['f2f2fe14-d74d-484b-915b-392bec22d002', '4e5b99c2-9e17-46fd-9640-85783ed29774', 'c178ae61-a7b0-4536-a821-d626ef20acdf', '6c15bfce-0e61-4d01-aba7-740e4a6fae3b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:34 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" returned: 0 in 0.375s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:34 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7 Sep 29 12:14:34 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d0ba40e4-bf03-4f93-b8af-963c66429f8b tempest-ProjectMemberTests-1935556730 None] Lock "cinder-805d3a59-42de-439a-a089-ec805d1950a8-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:34 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-quobyte-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7" released by "delete_volume" :: held 0.665s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Created reservations ['3bd19eff-ea5b-412c-af7e-a9b793d3d165', '62276a72-8813-4616-b5cb-a6d1abe355c5', '6d676271-44a3-490c-b9bf-e8effb5bf7ee', '55f7fb92-f8b5-47d4-91f1-ec5a07a7a1a3'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:34 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:34 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-19b4609e-846a-47a6-9311-777ec0421d7c-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-19b4609e-846a-47a6-9311-777ec0421d7c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-19b4609e-846a-47a6-9311-777ec0421d7c" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-19b4609e-846a-47a6-9311-777ec0421d7c" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bdadad-3cfc-4daf-bfdc-179560ab7cc4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:34 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Deleted volume successfully. Sep 29 12:14:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-e590fef6-3148-4c1f-bfa8-226e4fe007e5 tempest-SnapshotDependencyTests-6746670 None] Lock "cinder-c79de1fc-f01a-4947-9ef6-c5e3e14d54b7-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:35 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c Sep 29 12:14:35 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:35 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c" returned: 0 in 0.403s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:35 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c Sep 29 12:14:35 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:35 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-19b4609e-846a-47a6-9311-777ec0421d7c" returned: 0 in 0.248s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-19b4609e-846a-47a6-9311-777ec0421d7c" released by "delete_volume" :: held 0.746s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Created reservations ['579d85b0-9603-4180-9cf4-6ed576f372da', '15ec8651-9aff-4569-9ed7-7b0bb67a4048', '961b393e-c2b5-4636-ad56-6182dad8d771', '4625b733-c3a0-48aa-a10e-083a30245cda'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:35 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:35 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:35 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.272s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:35 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-463a4fff-abff-4947-9c40-b0be95b862c0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-19b4609e-846a-47a6-9311-777ec0421d7c-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (19d9d5c9-7e78-4eb5-a7c1-f381afd04810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c513f-27a0-4313-bfbc-d46fd4b80cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c513f-27a0-4313-bfbc-d46fd4b80cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924613017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b912d8-f9ae-4868-9405-35e8f98868b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:36Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2068c9-51b0-411f-9d6f-fda2729a4d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2068c9-51b0-411f-9d6f-fda2729a4d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bbb9bc-bd8f-4cbe-b4a8-8f2df3ac4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bbb9bc-bd8f-4cbe-b4a8-8f2df3ac4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b912d8-f9ae-4868-9405-35e8f98868b2', 'volume_name': 'volume-e4b912d8-f9ae-4868-9405-35e8f98868b2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecdae67-93ff-408c-8918-dac84ab6a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecdae67-93ff-408c-8918-dac84ab6a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470c3984-d621-4962-a48d-67cb1dd357ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:36 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Volume e4b912d8-f9ae-4868-9405-35e8f98868b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b912d8-f9ae-4868-9405-35e8f98868b2', 'volume_size': 1} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924613017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b912d8-f9ae-4868-9405-35e8f98868b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:36Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Creating volume e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:36 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:36 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 1073741824 Sep 29 12:14:36 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:36 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 1073741824" returned: 0 in 0.454s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:37 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 Sep 29 12:14:37 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:37 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2" returned: 0 in 0.260s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470c3984-d621-4962-a48d-67cb1dd357ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b912d8-f9ae-4868-9405-35e8f98868b2', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a5a0ca-b22c-45e8-a1a6-ddc247d8e511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:37 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Volume volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 (e4b912d8-f9ae-4868-9405-35e8f98868b2): created successfully Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a5a0ca-b22c-45e8-a1a6-ddc247d8e511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (19d9d5c9-7e78-4eb5-a7c1-f381afd04810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:37 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-153a0db6-1096-4878-8285-aa4066039ca9 tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot 39488f25-1cdf-42c5-bb64-2e28c3b20aa7 of volume e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b858bf2b-d772-4562-ae64-ee439b936992]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:37 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 Sep 29 12:14:37 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:38 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2" returned: 0 in 0.366s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:38 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 1G Sep 29 12:14:38 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:38 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 1G" returned: 0 in 0.459s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:38 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 Sep 29 12:14:38 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:38 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7" returned: 0 in 0.339s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:38 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 is being set with open permissions: ugo+rw Sep 29 12:14:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:38 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 Sep 29 12:14:38 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:39 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:39 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.info Sep 29 12:14:39 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:39 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.info" returned: 0 in 0.299s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:39 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.info is being set with open permissions: ugo+rw Sep 29 12:14:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:39 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.info Sep 29 12:14:39 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:39 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.info" returned: 0 in 0.247s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:39 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3623ecf9-1d3c-4d4f-b269-f8ffdc47f931 tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-39488f25-1cdf-42c5-bb64-2e28c3b20aa7-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-39488f25-1cdf-42c5-bb64-2e28c3b20aa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-e4b912d8-f9ae-4868-9405-35e8f98868b2" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e4b912d8-f9ae-4868-9405-35e8f98868b2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-39488f25-1cdf-42c5-bb64-2e28c3b20aa7" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-39488f25-1cdf-42c5-bb64-2e28c3b20aa7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot 39488f25-1cdf-42c5-bb64-2e28c3b20aa7 of volume e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd746b-f371-4907-8805-98164b8613f9]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:41 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 Sep 29 12:14:41 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:41 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b912d8-f9ae-4868-9405-35e8f98868b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d935b6-05b6-4a35-9a3b-59af1feaf536]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:41 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 Sep 29 12:14:41 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:41 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2" returned: 0 in 0.417s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:41 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 Sep 29 12:14:41 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:42 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7" returned: 0 in 0.346s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:42 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7 Sep 29 12:14:42 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:42 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2.39488f25-1cdf-42c5-bb64-2e28c3b20aa7" returned: 0 in 0.243s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-39488f25-1cdf-42c5-bb64-2e28c3b20aa7" released by "_delete_snapshot" :: held 1.489s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e4b912d8-f9ae-4868-9405-35e8f98868b2" released by "delete_snapshot" :: held 1.509s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:DELETE=14,cinder:SELECT=108,cinder:INSERT=41,cinder:UPDATE=127 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:INSERT=31,cinder:UPDATE=148,cinder:SELECT=110,cinder:DELETE=11 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Created reservations ['579cae6e-d80b-4db4-9341-76284bf2adef', '91672dd4-904d-4157-bbc9-f7e8823c6696', '117e9d5c-1c7d-4399-9d0f-e2c4fb1b6220', '45046ee7-e1a5-424b-adf2-f7039533a131'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:14:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5e42136c-5bfc-426a-a1dc-a4452b916c77 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-39488f25-1cdf-42c5-bb64-2e28c3b20aa7-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-e4b912d8-f9ae-4868-9405-35e8f98868b2-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-e4b912d8-f9ae-4868-9405-35e8f98868b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-e4b912d8-f9ae-4868-9405-35e8f98868b2" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e4b912d8-f9ae-4868-9405-35e8f98868b2" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4554e11d-6fee-4cdd-85d2-523a1feea990]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:43 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 Sep 29 12:14:43 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:43 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2" returned: 0 in 0.388s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:43 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2 Sep 29 12:14:43 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:43 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-e4b912d8-f9ae-4868-9405-35e8f98868b2" returned: 0 in 0.275s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e4b912d8-f9ae-4868-9405-35e8f98868b2" released by "delete_volume" :: held 0.751s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:43 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Created reservations ['691743f2-8a6d-4463-bbdc-3921efdf0832', '6eb7e871-3b1e-4b4c-aaae-7c1bb3f76543', '10c69009-ea40-489f-aefd-e50a345238f2', '9e819e68-bc84-4142-a5da-9211aa155914'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:44 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:44 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:44 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.268s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-41ab9a0b-b8cf-4717-9add-c1ad54a680e2 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-e4b912d8-f9ae-4868-9405-35e8f98868b2-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (ef9b5f87-1d74-4715-abfa-bd424a60c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adb0ab7-991e-4cea-b69f-818b3b437a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adb0ab7-991e-4cea-b69f-818b3b437a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337794531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03198d5-0fbf-467c-8229-983543fe2a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:45Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b709fd30-224e-4244-9de1-8062bbd47167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b709fd30-224e-4244-9de1-8062bbd47167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14e3559-4fe3-477e-b5a2-037b7e79e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14e3559-4fe3-477e-b5a2-037b7e79e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03198d5-0fbf-467c-8229-983543fe2a8a', 'volume_name': 'volume-f03198d5-0fbf-467c-8229-983543fe2a8a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f180d154-9baa-4da8-8d8f-f6cd814f9ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f180d154-9baa-4da8-8d8f-f6cd814f9ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bae32c8-dbf9-419e-a775-494107605fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:44 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Volume f03198d5-0fbf-467c-8229-983543fe2a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03198d5-0fbf-467c-8229-983543fe2a8a', 'volume_size': 1} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337794531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03198d5-0fbf-467c-8229-983543fe2a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:45Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Creating volume f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:44 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:44 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a 1073741824 Sep 29 12:14:44 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:45 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a 1073741824" returned: 0 in 0.506s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:45 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a Sep 29 12:14:45 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:45 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a" returned: 0 in 0.253s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bae32c8-dbf9-419e-a775-494107605fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03198d5-0fbf-467c-8229-983543fe2a8a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde49349-650d-4f3b-9379-2a77959b066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:45 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Volume volume-f03198d5-0fbf-467c-8229-983543fe2a8a (f03198d5-0fbf-467c-8229-983543fe2a8a): created successfully Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde49349-650d-4f3b-9379-2a77959b066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (ef9b5f87-1d74-4715-abfa-bd424a60c883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-cd31c15d-e935-47ec-9fd1-d545886cd282 tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:14:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot e1241225-8af8-48bc-b374-be94e50de1ab of volume f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:14:46 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbe2fa5-76ac-481a-a197-59285f5bec4e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:47 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a Sep 29 12:14:47 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:47 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:47 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab 1G Sep 29 12:14:47 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:47 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab 1G" returned: 0 in 0.363s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03198d5-0fbf-467c-8229-983543fe2a8a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:47 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03198d5-0fbf-467c-8229-983543fe2a8a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab Sep 29 12:14:47 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:47 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03198d5-0fbf-467c-8229-983543fe2a8a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab" returned: 0 in 0.281s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:47 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab is being set with open permissions: ugo+rw Sep 29 12:14:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:47 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab Sep 29 12:14:47 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:48 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab" returned: 0 in 0.226s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:48 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.info Sep 29 12:14:48 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:48 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.info" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:48 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.info is being set with open permissions: ugo+rw Sep 29 12:14:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:48 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.info Sep 29 12:14:48 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:48 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.info" returned: 0 in 0.238s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.755s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6154c0f6-26a0-48f9-8dcb-07cb8d0de9c7 tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-e1241225-8af8-48bc-b374-be94e50de1ab-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-e1241225-8af8-48bc-b374-be94e50de1ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-f03198d5-0fbf-467c-8229-983543fe2a8a" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-f03198d5-0fbf-467c-8229-983543fe2a8a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-e1241225-8af8-48bc-b374-be94e50de1ab" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e1241225-8af8-48bc-b374-be94e50de1ab" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot e1241225-8af8-48bc-b374-be94e50de1ab of volume f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb254c49-3f1a-430a-9e01-447ef41d2367]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:49 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab Sep 29 12:14:49 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:49 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab" returned: 0 in 0.347s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03198d5-0fbf-467c-8229-983543fe2a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fc04e-9e21-4a5c-a27d-542b4291fe99]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:49 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a Sep 29 12:14:49 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:49 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a" returned: 0 in 0.339s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:49 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab Sep 29 12:14:49 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:50 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab" returned: 0 in 0.328s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:50 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab Sep 29 12:14:50 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:50 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a.e1241225-8af8-48bc-b374-be94e50de1ab" returned: 0 in 0.231s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e1241225-8af8-48bc-b374-be94e50de1ab" released by "_delete_snapshot" :: held 1.343s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-f03198d5-0fbf-467c-8229-983543fe2a8a" released by "delete_snapshot" :: held 1.362s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:50 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Created reservations ['5d1629da-bcd3-4f0b-b332-23ece0bd515a', '4126d5e1-aee6-4041-bbfb-3ec3c91f2898', '041eea10-a591-4870-b2b1-bf7fa9a461cb', '307c73fd-6955-44e3-b98f-10ad785bb33c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:50 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:14:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7fd9f95b-bc14-4abb-aede-f121feb05353 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-e1241225-8af8-48bc-b374-be94e50de1ab-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-f03198d5-0fbf-467c-8229-983543fe2a8a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-f03198d5-0fbf-467c-8229-983543fe2a8a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-f03198d5-0fbf-467c-8229-983543fe2a8a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-f03198d5-0fbf-467c-8229-983543fe2a8a" acquired by "delete_volume" :: waited 0.012s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b868f-5932-4d1c-96a1-1324e4fac5cb]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:51 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a Sep 29 12:14:51 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:51 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a" returned: 0 in 0.347s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:51 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a Sep 29 12:14:51 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:51 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-f03198d5-0fbf-467c-8229-983543fe2a8a" returned: 0 in 0.244s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-f03198d5-0fbf-467c-8229-983543fe2a8a" released by "delete_volume" :: held 0.645s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:51 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Created reservations ['5c990edf-be43-440f-b37d-3f4e10f7a5b6', '61b37118-c762-4f8c-a37c-6af9d8db90de', 'e8ce0355-c087-459b-8d79-6fef1a86e021', 'f99c8db7-7e78-493b-8e08-5418f63477ae'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:52 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:52 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:52 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.238s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:52 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-d8fe2c25-12d2-4785-a64c-39ebb5205321 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-f03198d5-0fbf-467c-8229-983543fe2a8a-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (21c3e96d-f177-467a-83f8-0a0036880abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc745d99-b16b-4004-a919-2ec288ce2658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc745d99-b16b-4004-a919-2ec288ce2658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262145249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab5fdee-2ed1-4ef3-8046-c0e2d9607a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:53Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f637f09-5b52-462a-813c-97ed80d17d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f637f09-5b52-462a-813c-97ed80d17d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7755cc-4324-45ff-ad7e-b71b306ba68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7755cc-4324-45ff-ad7e-b71b306ba68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab5fdee-2ed1-4ef3-8046-c0e2d9607a67', 'volume_name': 'volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b70dba-7fb4-4cdd-bd89-26bec1cc9c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b70dba-7fb4-4cdd-bd89-26bec1cc9c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f379fe2e-78d6-4314-9d59-7d9bf8579a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:52 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Volume bab5fdee-2ed1-4ef3-8046-c0e2d9607a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67', 'volume_size': 1} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262145249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab5fdee-2ed1-4ef3-8046-c0e2d9607a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:14:53Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Creating volume bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:52 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:52 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:52 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 1073741824 Sep 29 12:14:52 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:53 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 1073741824" returned: 0 in 0.401s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:53 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 Sep 29 12:14:53 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:53 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f379fe2e-78d6-4314-9d59-7d9bf8579a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaffc8c-6208-4572-8af8-c4546149e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:53 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Volume volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 (bab5fdee-2ed1-4ef3-8046-c0e2d9607a67): created successfully Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaffc8c-6208-4572-8af8-c4546149e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (21c3e96d-f177-467a-83f8-0a0036880abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:53 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3675e53d-2032-48d0-9f58-f22e94b228ed tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot 0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 of volume bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc00d5-eff3-4bd1-a24b-ce75a2083cfa]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:53 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:54 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 Sep 29 12:14:54 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:54 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:54 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 1G Sep 29 12:14:54 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:54 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 1G" returned: 0 in 0.368s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:54 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 Sep 29 12:14:54 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:54 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" returned: 0 in 0.280s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:54 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 is being set with open permissions: ugo+rw Sep 29 12:14:54 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:54 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 Sep 29 12:14:54 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:55 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" returned: 0 in 0.228s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:55 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.info Sep 29 12:14:55 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:55 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.info" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:55 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.info is being set with open permissions: ugo+rw Sep 29 12:14:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:55 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.info Sep 29 12:14:55 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:55 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.info" returned: 0 in 0.237s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:55 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.769s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:55 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-292a159f-c50b-4ccc-81c6-929c9d1e9250 tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-0ef1da4e-2fd2-47f6-b34d-ad00cccb4544-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-0ef1da4e-2fd2-47f6-b34d-ad00cccb4544-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot 0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 of volume bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39fae60-e3e7-4073-a4d5-5ad41521bff4]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:56 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 Sep 29 12:14:56 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:56 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c0c8c-34ec-4fc5-9e65-e3c2c435907e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:56 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 Sep 29 12:14:56 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:56 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" returned: 0 in 0.340s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:56 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:56 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 Sep 29 12:14:56 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:57 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" returned: 0 in 0.313s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:57 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544 Sep 29 12:14:57 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:57 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:57 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67.0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" returned: 0 in 0.232s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-0ef1da4e-2fd2-47f6-b34d-ad00cccb4544" released by "_delete_snapshot" :: held 1.335s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" released by "delete_snapshot" :: held 1.355s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:57 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Created reservations ['bbc2dcec-0e85-40ee-b322-7df55349d88a', 'aa14fb51-ed4d-4a12-994e-9cea529e0fde', '652bd011-2f22-4cde-9c35-f179df53ed1d', '3b3b4709-71df-4bde-946b-3e6327e4905b'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:57 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:14:57 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-de93f06b-f976-4a11-973b-4ce94c7c7af0 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-0ef1da4e-2fd2-47f6-b34d-ad00cccb4544-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Lock "cinder-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" acquired by "delete_volume" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf47249-3217-49c6-8604-be21f2f7eec8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:58 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 Sep 29 12:14:58 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:58 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" returned: 0 in 0.335s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:58 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67 Sep 29 12:14:58 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:58 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" returned: 0 in 0.231s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67" released by "delete_volume" :: held 0.621s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Created reservations ['1a100bd5-3d56-45b2-8063-4bfe77b1e2c4', '3aeb463a-f227-4bfb-81bf-9f157d467246', 'fdd80f21-ef5c-4777-874d-3b775afcea02', 'a7c34a75-af30-47b6-bee2-ea37dcd091b8'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:58 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:59 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:14:59 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:14:59 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.227s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:14:59 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-fe9b8a0f-4650-4f33-8573-d5dbd38aa20d tempest-ProjectMemberTests-1935556730 None] Lock "cinder-bab5fdee-2ed1-4ef3-8046-c0e2d9607a67-delete_volume" released by "delete_volume" :: held 1.017s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (b03bd212-bbd1-456e-9f18-4d62a1b41d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b1d3e1-ce53-4e1c-ae2e-322525290af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b1d3e1-ce53-4e1c-ae2e-322525290af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719680465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be432c2-7c1a-4b58-9a48-1765338a0631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:00Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12db5b4-169b-406e-aab6-cb515dcd271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12db5b4-169b-406e-aab6-cb515dcd271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4499d4-4a58-4c03-941f-7c39153d53ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4499d4-4a58-4c03-941f-7c39153d53ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be432c2-7c1a-4b58-9a48-1765338a0631', 'volume_name': 'volume-4be432c2-7c1a-4b58-9a48-1765338a0631', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0b72d9-0cde-4f18-91cb-c804dc0ed179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0b72d9-0cde-4f18-91cb-c804dc0ed179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c59746b-bcef-48e3-a50b-1c95c6e9af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:14:59 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Volume 4be432c2-7c1a-4b58-9a48-1765338a0631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be432c2-7c1a-4b58-9a48-1765338a0631', 'volume_size': 1} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719680465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be432c2-7c1a-4b58-9a48-1765338a0631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:00Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Creating volume 4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:14:59 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:14:59 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:14:59 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 1073741824 Sep 29 12:14:59 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:00 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 1073741824" returned: 0 in 0.388s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:00 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 Sep 29 12:15:00 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:00 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631" returned: 0 in 0.233s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c59746b-bcef-48e3-a50b-1c95c6e9af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be432c2-7c1a-4b58-9a48-1765338a0631', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc1a8d9-8653-4903-adb7-988bb01e4da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:00 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Volume volume-4be432c2-7c1a-4b58-9a48-1765338a0631 (4be432c2-7c1a-4b58-9a48-1765338a0631): created successfully Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc1a8d9-8653-4903-adb7-988bb01e4da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (b03bd212-bbd1-456e-9f18-4d62a1b41d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:00 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-35e5030e-1826-4a12-854f-9b0f9e4d4a73 tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot e1b836fe-81f5-4813-8c09-b9d70e7d72da of volume 4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b15998-2675-4094-8858-3bad6eb72e37]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:00 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:01 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 Sep 29 12:15:01 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:01 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631" returned: 0 in 0.340s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:01 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da 1G Sep 29 12:15:01 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:01 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da 1G" returned: 0 in 0.368s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be432c2-7c1a-4b58-9a48-1765338a0631 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:01 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be432c2-7c1a-4b58-9a48-1765338a0631 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da Sep 29 12:15:01 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:01 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be432c2-7c1a-4b58-9a48-1765338a0631 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da" returned: 0 in 0.268s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:01 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da is being set with open permissions: ugo+rw Sep 29 12:15:01 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:01 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da Sep 29 12:15:01 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:02 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da" returned: 0 in 0.232s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:02 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.info Sep 29 12:15:02 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:02 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.info" returned: 0 in 0.243s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:02 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.info is being set with open permissions: ugo+rw Sep 29 12:15:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:02 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.info Sep 29 12:15:02 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:02 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.info" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:02 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.765s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:02 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f72fe09d-65a0-4ba9-9d52-1c784e3de146 tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-e1b836fe-81f5-4813-8c09-b9d70e7d72da-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Lock "cinder-e1b836fe-81f5-4813-8c09-b9d70e7d72da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-4be432c2-7c1a-4b58-9a48-1765338a0631" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-4be432c2-7c1a-4b58-9a48-1765338a0631" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-e1b836fe-81f5-4813-8c09-b9d70e7d72da" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e1b836fe-81f5-4813-8c09-b9d70e7d72da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot e1b836fe-81f5-4813-8c09-b9d70e7d72da of volume 4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d91bc-ede7-4ab9-b02e-b2e48468db96]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:03 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da Sep 29 12:15:03 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:03 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da" returned: 0 in 0.344s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4be432c2-7c1a-4b58-9a48-1765338a0631(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[80361c7f-a1ca-4243-8ee5-c1206f53ea5c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:03 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 Sep 29 12:15:03 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:03 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:03 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:03 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da Sep 29 12:15:03 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:04 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da" returned: 0 in 0.340s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:04 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da Sep 29 12:15:04 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:04 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:04 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631.e1b836fe-81f5-4813-8c09-b9d70e7d72da" returned: 0 in 0.243s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-e1b836fe-81f5-4813-8c09-b9d70e7d72da" released by "_delete_snapshot" :: held 1.359s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-4be432c2-7c1a-4b58-9a48-1765338a0631" released by "delete_snapshot" :: held 1.380s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:04 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Created reservations ['e13ab9f1-fea6-40fe-9ebe-d4f2fad90429', '109c89d7-82e1-467b-8b51-263604f02b1e', 'dae02a20-af9e-4437-8ceb-071cbf32029f', '73a9ebf0-6fab-4dda-a7b9-0e3f91ea0270'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:04 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:15:04 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-5acd7430-97a4-4ce9-a524-b348a16e84ef tempest-ProjectMemberTests-1935556730 None] Lock "cinder-e1b836fe-81f5-4813-8c09-b9d70e7d72da-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-4be432c2-7c1a-4b58-9a48-1765338a0631-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-4be432c2-7c1a-4b58-9a48-1765338a0631-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-4be432c2-7c1a-4b58-9a48-1765338a0631" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-4be432c2-7c1a-4b58-9a48-1765338a0631" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceb8fc8-ce1d-4d9b-a4c1-1f904cadee1a]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:05 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 Sep 29 12:15:05 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:05 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631" returned: 0 in 0.333s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:05 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631 Sep 29 12:15:05 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:05 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-4be432c2-7c1a-4b58-9a48-1765338a0631" returned: 0 in 0.238s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-4be432c2-7c1a-4b58-9a48-1765338a0631" released by "delete_volume" :: held 0.634s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:05 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Created reservations ['054a5bf3-79fb-413d-8616-a25f4abfcad6', 'd8b9e180-9980-44ed-ba04-3a4c30c1d73f', '533cdac2-7562-4b19-9868-434481d70bea', '846a8379-d2fd-4d40-9bbb-08a342953b4a'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:06 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:06 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:06 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.230s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:06 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-0fcf1c72-2754-4bfd-a5e3-d3eba80fa283 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-4be432c2-7c1a-4b58-9a48-1765338a0631-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (888e6b28-5f35-49e8-827a-e100485ac570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8b7e1d-cbdc-4dda-b044-372fa5612724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8b7e1d-cbdc-4dda-b044-372fa5612724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191705422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c8af5f-7acf-419f-adda-d76a5245a35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:07Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf2ca4a-7799-4944-a5df-642aa1e7d7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf2ca4a-7799-4944-a5df-642aa1e7d7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12624c9b-13e7-42cb-a916-ca12da23812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12624c9b-13e7-42cb-a916-ca12da23812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c8af5f-7acf-419f-adda-d76a5245a35a', 'volume_name': 'volume-98c8af5f-7acf-419f-adda-d76a5245a35a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e5c003-6ed8-4fb1-a399-fcbf81cc50d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e5c003-6ed8-4fb1-a399-fcbf81cc50d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08ce66c-b7b4-456e-8852-95eaa751ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:06 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Volume 98c8af5f-7acf-419f-adda-d76a5245a35a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c8af5f-7acf-419f-adda-d76a5245a35a', 'volume_size': 1} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191705422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c8af5f-7acf-419f-adda-d76a5245a35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53e86721154fc2a2c03be43c8e7dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:07Z,use_quota=True,user_id='c9b31d854a7a473ab8cb578ed86e77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Creating volume 98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:15:06 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:15:06 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:06 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a 1073741824 Sep 29 12:15:06 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:07 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a 1073741824" returned: 0 in 0.410s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:07 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a Sep 29 12:15:07 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:07 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08ce66c-b7b4-456e-8852-95eaa751ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c8af5f-7acf-419f-adda-d76a5245a35a', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8404c855-7fcc-46c8-9bc0-df751535d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:07 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Volume volume-98c8af5f-7acf-419f-adda-d76a5245a35a (98c8af5f-7acf-419f-adda-d76a5245a35a): created successfully Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8404c855-7fcc-46c8-9bc0-df751535d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Flow 'volume_create_manager' (888e6b28-5f35-49e8-827a-e100485ac570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:07 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3fae865e-3722-4c3d-b923-39023be0606a tempest-ProjectMemberTests-1935556730 None] Created volume successfully. Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Creating offline snapshot 4ebe5e34-1551-4caa-8d9b-8ef43694a2fc of volume 98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba2b7c-72f3-4c93-919b-19121a5fc702]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:07 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:08 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a Sep 29 12:15:08 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:08 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:08 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc 1G Sep 29 12:15:08 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:08 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc 1G" returned: 0 in 0.359s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98c8af5f-7acf-419f-adda-d76a5245a35a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:08 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98c8af5f-7acf-419f-adda-d76a5245a35a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc Sep 29 12:15:08 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:08 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98c8af5f-7acf-419f-adda-d76a5245a35a -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" returned: 0 in 0.264s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:08 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc is being set with open permissions: ugo+rw Sep 29 12:15:08 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:08 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc Sep 29 12:15:08 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:09 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" returned: 0 in 0.229s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:09 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.info Sep 29 12:15:09 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:09 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.info" returned: 0 in 0.237s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:09 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.info is being set with open permissions: ugo+rw Sep 29 12:15:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:09 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.info Sep 29 12:15:09 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:09 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.info" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:09 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.737s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:09 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c9c72b07-a9c8-4991-b574-92d409218d33 tempest-ProjectMemberTests-1935556730 None] Create snapshot completed successfully Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-4ebe5e34-1551-4caa-8d9b-8ef43694a2fc-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-4ebe5e34-1551-4caa-8d9b-8ef43694a2fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-98c8af5f-7acf-419f-adda-d76a5245a35a" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-98c8af5f-7acf-419f-adda-d76a5245a35a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Deleting offline snapshot 4ebe5e34-1551-4caa-8d9b-8ef43694a2fc of volume 98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] snapshot_file for this snap is: volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9f3079-85e5-40a1-acf5-82ee8209c779]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:10 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc Sep 29 12:15:10 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:10 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" returned: 0 in 0.340s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98c8af5f-7acf-419f-adda-d76a5245a35a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31d90b-c5e7-43c3-8973-1cd2c126b61c]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:10 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a Sep 29 12:15:10 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:10 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a" returned: 0 in 0.337s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:10 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:10 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc Sep 29 12:15:10 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:11 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" returned: 0 in 0.325s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:11 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc Sep 29 12:15:11 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:11 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:11 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a.4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" returned: 0 in 0.237s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-4ebe5e34-1551-4caa-8d9b-8ef43694a2fc" released by "_delete_snapshot" :: held 1.335s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-98c8af5f-7acf-419f-adda-d76a5245a35a" released by "delete_snapshot" :: held 1.355s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:11 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Created reservations ['5039af3d-e84e-4994-aa38-25c1705c5d2b', '6be1dc39-43ea-44ee-80e5-2dfe926808ab', '65647463-24a0-4eef-b87e-46c64a48b5c7', '7b4a9a58-bf8d-4e19-9c09-aca04b6b49be'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:11 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Delete snapshot completed successfully. Sep 29 12:15:11 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-40268a37-d8c2-426f-b358-0d56646e7917 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-4ebe5e34-1551-4caa-8d9b-8ef43694a2fc-delete_snapshot" released by "delete_snapshot" :: held 1.478s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:12 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:12 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-98c8af5f-7acf-419f-adda-d76a5245a35a-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-98c8af5f-7acf-419f-adda-d76a5245a35a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:12 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.250s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "cinder-quobyte-98c8af5f-7acf-419f-adda-d76a5245a35a" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-98c8af5f-7acf-419f-adda-d76a5245a35a" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41e2b4-c223-408f-8ac0-b525c5073a0e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:12 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a Sep 29 12:15:12 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:12 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a" returned: 0 in 0.353s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:12 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a Sep 29 12:15:12 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:13 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-98c8af5f-7acf-419f-adda-d76a5245a35a" returned: 0 in 0.248s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-quobyte-98c8af5f-7acf-419f-adda-d76a5245a35a" released by "delete_volume" :: held 0.655s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Created reservations ['2837876e-d4c3-4a91-9e40-68d241a3a885', '5403b1d0-b4fc-450f-b585-7116208b4c4e', '1e8b9fe8-a32d-4519-a1ce-8cc1ccff7037', '764ded25-9572-4de7-82d2-44491bb573ef'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:13 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:13 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:13 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.223s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:13 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Deleted volume successfully. Sep 29 12:15:13 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a4f78ca6-4b16-4622-af66-f1f546276392 tempest-ProjectMemberTests-1935556730 None] Lock "cinder-98c8af5f-7acf-419f-adda-d76a5245a35a-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (1ef2d820-1ae8-4f74-9685-cab010f2e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdcb015-f65d-4e99-9ce1-20918ad2665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdcb015-f65d-4e99-9ce1-20918ad2665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674810299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a26eecd-8baf-489b-8e30-686a17a6a456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:17Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cc7b15-157a-499d-83c3-3d201ca58f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cc7b15-157a-499d-83c3-3d201ca58f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bb16b0-eb42-4c5b-8832-f6d2a91319b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bb16b0-eb42-4c5b-8832-f6d2a91319b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a26eecd-8baf-489b-8e30-686a17a6a456', 'volume_name': 'volume-8a26eecd-8baf-489b-8e30-686a17a6a456', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5fa8e2-acd2-43b6-8e2a-fd5e8b8afaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5fa8e2-acd2-43b6-8e2a-fd5e8b8afaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f747b13d-e31f-4480-878c-308c708acce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Volume 8a26eecd-8baf-489b-8e30-686a17a6a456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a26eecd-8baf-489b-8e30-686a17a6a456', 'volume_size': 1} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674810299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a26eecd-8baf-489b-8e30-686a17a6a456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:17Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Creating volume 8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:15:17 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:17 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 1073741824 Sep 29 12:15:17 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:17 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 1073741824" returned: 0 in 0.405s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:17 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 Sep 29 12:15:17 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:17 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456" returned: 0 in 0.243s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f747b13d-e31f-4480-878c-308c708acce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a26eecd-8baf-489b-8e30-686a17a6a456', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76dfc2c-765a-431a-83a5-07f4044fbb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:17 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Volume volume-8a26eecd-8baf-489b-8e30-686a17a6a456 (8a26eecd-8baf-489b-8e30-686a17a6a456): created successfully Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76dfc2c-765a-431a-83a5-07f4044fbb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:17 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (1ef2d820-1ae8-4f74-9685-cab010f2e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:17 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-3db691be-89e7-428c-9032-a4c3c6431312 tempest-ProjectReaderTests-434669907 None] Created volume successfully. Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Creating offline snapshot fc86b887-d2c2-4147-a2fb-38c602e7bd01 of volume 8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c373fc-fe61-4519-ae88-afd231d76420]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:18 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 Sep 29 12:15:18 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:18 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456" returned: 0 in 0.350s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:18 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 1G Sep 29 12:15:18 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:18 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 1G" returned: 0 in 0.380s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:18 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a26eecd-8baf-489b-8e30-686a17a6a456 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:19 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a26eecd-8baf-489b-8e30-686a17a6a456 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 Sep 29 12:15:19 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:19 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a26eecd-8baf-489b-8e30-686a17a6a456 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01" returned: 0 in 0.290s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:19 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 is being set with open permissions: ugo+rw Sep 29 12:15:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:19 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 Sep 29 12:15:19 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:19 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:19 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.info Sep 29 12:15:19 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:19 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.info" returned: 0 in 0.252s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:19 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.info is being set with open permissions: ugo+rw Sep 29 12:15:19 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:19 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.info Sep 29 12:15:19 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:20 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.info" returned: 0 in 0.244s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:20 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-6f993738-e84b-4ef9-a7d0-fb0aaeb922af tempest-ProjectReaderTests-434669907 None] Create snapshot completed successfully Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-fc86b887-d2c2-4147-a2fb-38c602e7bd01-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Lock "cinder-fc86b887-d2c2-4147-a2fb-38c602e7bd01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-8a26eecd-8baf-489b-8e30-686a17a6a456" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-8a26eecd-8baf-489b-8e30-686a17a6a456" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-fc86b887-d2c2-4147-a2fb-38c602e7bd01" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-fc86b887-d2c2-4147-a2fb-38c602e7bd01" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Deleting offline snapshot fc86b887-d2c2-4147-a2fb-38c602e7bd01 of volume 8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] snapshot_file for this snap is: volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[107d129d-2512-4f28-a470-7deb61f1762f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:20 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 Sep 29 12:15:20 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:20 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a26eecd-8baf-489b-8e30-686a17a6a456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b87933f-b1b1-435d-b598-3b5da9f1eba8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:20 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:21 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 Sep 29 12:15:21 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:21 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456" returned: 0 in 0.341s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:21 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 Sep 29 12:15:21 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:21 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01" returned: 0 in 0.327s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:21 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01 Sep 29 12:15:21 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:21 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456.fc86b887-d2c2-4147-a2fb-38c602e7bd01" returned: 0 in 0.239s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-fc86b887-d2c2-4147-a2fb-38c602e7bd01" released by "_delete_snapshot" :: held 1.359s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-8a26eecd-8baf-489b-8e30-686a17a6a456" released by "delete_snapshot" :: held 1.378s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Created reservations ['030e81de-4845-4e0d-ab8d-122c640c9c42', '7553f1a7-2f7e-4278-acb1-bd73852de030', 'a80120c3-a1ff-4762-8964-eea4d04b63b1', 'a4d69eae-0815-446e-a86d-5dfd747fd188'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:21 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Delete snapshot completed successfully. Sep 29 12:15:21 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-aa018597-3e9e-4149-b7b0-c366d1bf3e50 tempest-ProjectReaderTests-434669907 None] Lock "cinder-fc86b887-d2c2-4147-a2fb-38c602e7bd01-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-8a26eecd-8baf-489b-8e30-686a17a6a456-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Lock "cinder-8a26eecd-8baf-489b-8e30-686a17a6a456-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-8a26eecd-8baf-489b-8e30-686a17a6a456" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:22 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-8a26eecd-8baf-489b-8e30-686a17a6a456" acquired by "delete_volume" :: waited 0.015s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:22 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ad809-8ffc-414d-8dca-be92a58767ba]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:22 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:22 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 Sep 29 12:15:22 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:23 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456" returned: 0 in 0.365s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:23 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456 Sep 29 12:15:23 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:23 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-8a26eecd-8baf-489b-8e30-686a17a6a456" returned: 0 in 0.242s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-8a26eecd-8baf-489b-8e30-686a17a6a456" released by "delete_volume" :: held 0.665s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Created reservations ['39b9ffec-0927-4cf0-9ac6-60c3331088ca', '3318203a-faa3-4dc7-8f52-a87f0dead985', '2c5bff56-0879-4911-b0a3-9d6ee53c0786', 'c75d08d7-ac6d-46e7-a259-2689090e5b13'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:23 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:23 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:23 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.245s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:23 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Deleted volume successfully. Sep 29 12:15:23 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-7207a02d-7a27-4884-86b7-19c0301d91ea tempest-ProjectReaderTests-434669907 None] Lock "cinder-8a26eecd-8baf-489b-8e30-686a17a6a456-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (2a8079c1-710b-4938-b987-4b5b94ceec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fb5465-1d59-4662-adec-71842d51d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fb5465-1d59-4662-adec-71842d51d17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026607268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2590bcc8-8d87-4895-9f7d-2f39eaef5741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:24Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3026d2d-68ea-4dd1-aa6f-4e5f664d596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3026d2d-68ea-4dd1-aa6f-4e5f664d596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90746a5-ceed-4256-aa33-dfa7b9f5795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90746a5-ceed-4256-aa33-dfa7b9f5795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2590bcc8-8d87-4895-9f7d-2f39eaef5741', 'volume_name': 'volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f70f841-e0c8-4bd0-b65b-d9a3c8d8207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f70f841-e0c8-4bd0-b65b-d9a3c8d8207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74667f08-c2a4-46ff-86b2-912d5c255712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:24 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Volume 2590bcc8-8d87-4895-9f7d-2f39eaef5741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741', 'volume_size': 1} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026607268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2590bcc8-8d87-4895-9f7d-2f39eaef5741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:24Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Creating volume 2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:15:24 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:24 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 1073741824 Sep 29 12:15:24 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:24 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 1073741824" returned: 0 in 0.421s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:24 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:24 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 Sep 29 12:15:24 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:24 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741" returned: 0 in 0.262s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74667f08-c2a4-46ff-86b2-912d5c255712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fafab30-cf91-4e87-a74c-7aa5ac21eae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:25 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Volume volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 (2590bcc8-8d87-4895-9f7d-2f39eaef5741): created successfully Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fafab30-cf91-4e87-a74c-7aa5ac21eae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (2a8079c1-710b-4938-b987-4b5b94ceec19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:25 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-54b0ab87-1a14-419c-a919-2ee15dec7cf5 tempest-ProjectReaderTests-434669907 None] Created volume successfully. Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Creating offline snapshot 7d41e585-09f5-478e-b57c-04fb7c9117f4 of volume 2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[123055d9-ee38-4619-bf77-33b8502b6144]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:25 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 Sep 29 12:15:25 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:25 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741" returned: 0 in 0.355s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:25 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:25 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 1G Sep 29 12:15:25 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:26 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 1G" returned: 0 in 0.386s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:26 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 Sep 29 12:15:26 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:26 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4" returned: 0 in 0.282s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:26 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 is being set with open permissions: ugo+rw Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:26 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 Sep 29 12:15:26 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:26 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4" returned: 0 in 0.239s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:26 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.info Sep 29 12:15:26 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:26 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.info" returned: 0 in 0.252s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:26 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.info is being set with open permissions: ugo+rw Sep 29 12:15:26 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:26 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.info Sep 29 12:15:26 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:27 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.info" returned: 0 in 0.250s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:27 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-227fd45a-e6a2-42da-a86d-0cdb983b49db tempest-ProjectReaderTests-434669907 None] Create snapshot completed successfully Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-7d41e585-09f5-478e-b57c-04fb7c9117f4-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Lock "cinder-7d41e585-09f5-478e-b57c-04fb7c9117f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-2590bcc8-8d87-4895-9f7d-2f39eaef5741" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-2590bcc8-8d87-4895-9f7d-2f39eaef5741" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-7d41e585-09f5-478e-b57c-04fb7c9117f4" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-7d41e585-09f5-478e-b57c-04fb7c9117f4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Deleting offline snapshot 7d41e585-09f5-478e-b57c-04fb7c9117f4 of volume 2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] snapshot_file for this snap is: volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb0139-f3af-454f-b799-ec29cbd26f19]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:27 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 Sep 29 12:15:27 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:27 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4" returned: 0 in 0.357s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b547a5c-207f-4ee5-9022-0290b374f724]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:27 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:28 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 Sep 29 12:15:28 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:28 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741" returned: 0 in 0.355s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:28 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 Sep 29 12:15:28 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:28 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4" returned: 0 in 0.331s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:28 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4 Sep 29 12:15:28 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:28 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741.7d41e585-09f5-478e-b57c-04fb7c9117f4" returned: 0 in 0.243s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-7d41e585-09f5-478e-b57c-04fb7c9117f4" released by "_delete_snapshot" :: held 1.389s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-2590bcc8-8d87-4895-9f7d-2f39eaef5741" released by "delete_snapshot" :: held 1.408s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:28 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Created reservations ['069b015e-750f-478d-bbfa-62d839851805', 'fa7964b3-2ba1-4df7-b9e4-8fd160a08fa1', '472e1e20-3d54-4fcb-9ce9-baafbb9e807f', 'a866d222-e138-45a9-a8dc-0d4eec85457f'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:29 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Delete snapshot completed successfully. Sep 29 12:15:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-4e9f49d3-8a1c-4085-a369-8d352f20c16c tempest-ProjectReaderTests-434669907 None] Lock "cinder-7d41e585-09f5-478e-b57c-04fb7c9117f4-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-2590bcc8-8d87-4895-9f7d-2f39eaef5741-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Lock "cinder-2590bcc8-8d87-4895-9f7d-2f39eaef5741-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-2590bcc8-8d87-4895-9f7d-2f39eaef5741" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:29 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-2590bcc8-8d87-4895-9f7d-2f39eaef5741" acquired by "delete_volume" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:29 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[15940d09-8e74-48c3-b45b-75bd389b1e01]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:29 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:29 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 Sep 29 12:15:29 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:30 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741" returned: 0 in 0.357s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:30 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741 Sep 29 12:15:30 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:30 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-2590bcc8-8d87-4895-9f7d-2f39eaef5741" returned: 0 in 0.246s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-2590bcc8-8d87-4895-9f7d-2f39eaef5741" released by "delete_volume" :: held 0.661s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Created reservations ['a31b2bb5-fde5-454e-b8c4-a46e8ffbd0ea', '18bf9042-d8da-4e84-b31e-bf1aaced0fd6', '6ae867b5-ad30-4bcf-a85b-1a8664eb1937', '1f910eed-799c-40b3-9c75-6b1a34edca48'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:30 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:30 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:30 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:30 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Deleted volume successfully. Sep 29 12:15:30 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-f81d63ad-36ec-48cf-9bd6-c4ab35f37439 tempest-ProjectReaderTests-434669907 None] Lock "cinder-2590bcc8-8d87-4895-9f7d-2f39eaef5741-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (eb2d7a28-34f4-4f5c-b5d7-9b27129d1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086f4c37-fcdb-4252-9b5e-84d68411b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086f4c37-fcdb-4252-9b5e-84d68411b676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505780397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b5b0c7-0c76-4536-804f-eda3fdc0a9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:31Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d67ab05-6e1d-4f65-9a29-4066f40646b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d67ab05-6e1d-4f65-9a29-4066f40646b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e282ff-e26a-4382-a530-ba280c6f7324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e282ff-e26a-4382-a530-ba280c6f7324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b5b0c7-0c76-4536-804f-eda3fdc0a9b0', 'volume_name': 'volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c4b04f-fd9a-422f-ab34-10ba229c4095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c4b04f-fd9a-422f-ab34-10ba229c4095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43526d54-335d-41d2-b0a0-085d5c3d42a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Volume 42b5b0c7-0c76-4536-804f-eda3fdc0a9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0', 'volume_size': 1} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505780397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b5b0c7-0c76-4536-804f-eda3fdc0a9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:31Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Creating volume 42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:15:31 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:31 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 1073741824 Sep 29 12:15:31 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:31 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 1073741824" returned: 0 in 0.396s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:31 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 Sep 29 12:15:31 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:31 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43526d54-335d-41d2-b0a0-085d5c3d42a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855e4d0b-9724-4ba0-815e-86df98c06d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:31 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Volume volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 (42b5b0c7-0c76-4536-804f-eda3fdc0a9b0): created successfully Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855e4d0b-9724-4ba0-815e-86df98c06d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:31 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (eb2d7a28-34f4-4f5c-b5d7-9b27129d1b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:31 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-58113ce7-762e-4537-8166-64e6fc0c9212 tempest-ProjectReaderTests-434669907 None] Created volume successfully. Sep 29 12:15:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:32 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Creating offline snapshot b4c14212-e089-4d95-a35d-2be154f8faa3 of volume 42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:15:32 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a51d850-3227-4628-b995-0ca7c1071b1e]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:32 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 Sep 29 12:15:32 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:32 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" returned: 0 in 0.341s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:32 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:32 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 1G Sep 29 12:15:32 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:33 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 1G" returned: 0 in 0.373s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:33 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 Sep 29 12:15:33 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:33 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3" returned: 0 in 0.277s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:33 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 is being set with open permissions: ugo+rw Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:33 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 Sep 29 12:15:33 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:33 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:33 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.info Sep 29 12:15:33 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:33 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.info" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:33 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.info is being set with open permissions: ugo+rw Sep 29 12:15:33 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:33 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.info Sep 29 12:15:33 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:34 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.info" returned: 0 in 0.235s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.785s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:34 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-4155ce19-f289-4f72-9e28-690775194478 tempest-ProjectReaderTests-434669907 None] Create snapshot completed successfully Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-b4c14212-e089-4d95-a35d-2be154f8faa3-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Lock "cinder-b4c14212-e089-4d95-a35d-2be154f8faa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-b4c14212-e089-4d95-a35d-2be154f8faa3" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-b4c14212-e089-4d95-a35d-2be154f8faa3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Deleting offline snapshot b4c14212-e089-4d95-a35d-2be154f8faa3 of volume 42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] snapshot_file for this snap is: volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e6700b-a872-40c8-9b6d-9435295c5321]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:34 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 Sep 29 12:15:34 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:34 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3" returned: 0 in 0.343s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[54619182-d258-42af-8717-b39c3d5f0b7b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:34 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:34 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 Sep 29 12:15:34 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:35 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" returned: 0 in 0.338s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:35 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 Sep 29 12:15:35 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:35 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3" returned: 0 in 0.312s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:35 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3 Sep 29 12:15:35 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:35 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0.b4c14212-e089-4d95-a35d-2be154f8faa3" returned: 0 in 0.232s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-b4c14212-e089-4d95-a35d-2be154f8faa3" released by "_delete_snapshot" :: held 1.314s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" released by "delete_snapshot" :: held 1.337s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Created reservations ['dda80c28-47b8-4925-a6a0-5e1a3fdfb49d', '3b8ac241-9101-4b56-bd91-0a39105193f4', 'a6108a20-4128-48f1-928c-8176a5b76e83', 'c076a2c6-6104-49aa-8cc1-41f173d39960'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:35 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Delete snapshot completed successfully. Sep 29 12:15:35 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-69425257-24b1-463b-94f5-fc495a407116 tempest-ProjectReaderTests-434669907 None] Lock "cinder-b4c14212-e089-4d95-a35d-2be154f8faa3-delete_snapshot" released by "delete_snapshot" :: held 1.469s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Lock "cinder-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:36 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" acquired by "delete_volume" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:36 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6761bf5-bb39-4b0e-8304-4ed3bd4508fc]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:36 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:36 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 Sep 29 12:15:36 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:37 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" returned: 0 in 0.340s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:37 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0 Sep 29 12:15:37 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:37 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" returned: 0 in 0.235s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0" released by "delete_volume" :: held 0.633s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Created reservations ['97270415-b62f-44b0-9592-265f2fe46849', 'fb43d9c9-780a-4ea6-bad9-5e31ac1aa558', 'd469b499-4afa-412f-884d-01825c4aaa57', 'b9700d88-39a3-4b0a-90f1-b314c07a8cbe'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:37 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:37 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:37 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.226s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:37 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Deleted volume successfully. Sep 29 12:15:37 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-a79a8b02-464f-4075-98ff-10f410d59dd6 tempest-ProjectReaderTests-434669907 None] Lock "cinder-42b5b0c7-0c76-4536-804f-eda3fdc0a9b0-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (848abe98-0d0b-4bf2-bbc5-bd69ff140bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b5a5c8-7c1c-432e-b31c-faa86d9144eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b5a5c8-7c1c-432e-b31c-faa86d9144eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215837982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e33dde-6862-471d-b8e6-4ccc2e643b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:38Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514f448c-6082-4613-b788-7e4e1c9d9255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514f448c-6082-4613-b788-7e4e1c9d9255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea24809-537d-43c4-a580-23cdb94f6ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea24809-537d-43c4-a580-23cdb94f6ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e33dde-6862-471d-b8e6-4ccc2e643b1b', 'volume_name': 'volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6487bcea-2bfc-44d1-8459-94ed66bccfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6487bcea-2bfc-44d1-8459-94ed66bccfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b7551d-a304-4aa8-9f39-d23592c9086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:38 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Volume 14e33dde-6862-471d-b8e6-4ccc2e643b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b', 'volume_size': 1} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215837982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e33dde-6862-471d-b8e6-4ccc2e643b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:38Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Creating volume 14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:15:38 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:38 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b 1073741824 Sep 29 12:15:38 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:38 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b 1073741824" returned: 0 in 0.394s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:38 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b Sep 29 12:15:38 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:38 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b" returned: 0 in 0.230s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b7551d-a304-4aa8-9f39-d23592c9086b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898129bd-a624-4a88-8150-c738dcb6157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:38 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Volume volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b (14e33dde-6862-471d-b8e6-4ccc2e643b1b): created successfully Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898129bd-a624-4a88-8150-c738dcb6157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:38 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (848abe98-0d0b-4bf2-bbc5-bd69ff140bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:38 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-39275c48-a5ac-4dea-a051-626985b00de1 tempest-ProjectReaderTests-434669907 None] Created volume successfully. Sep 29 12:15:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:39 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Creating offline snapshot f34b1ad4-8f11-40a6-8237-3010bb430478 of volume 14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:15:39 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9801181-c928-451a-9e76-84db05d9846f]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:39 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b Sep 29 12:15:39 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:39 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:39 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:39 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 1G Sep 29 12:15:39 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:40 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 1G" returned: 0 in 0.399s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:40 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 Sep 29 12:15:40 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:40 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478" returned: 0 in 0.282s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:40 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 is being set with open permissions: ugo+rw Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:40 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 Sep 29 12:15:40 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:40 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478" returned: 0 in 0.249s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:40 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.info Sep 29 12:15:40 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:40 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.info" returned: 0 in 0.251s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:40 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.info is being set with open permissions: ugo+rw Sep 29 12:15:40 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:40 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.info Sep 29 12:15:40 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:41 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.info" returned: 0 in 0.239s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:41 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-0ce361ad-641e-452d-a6b2-380504d3ce83 tempest-ProjectReaderTests-434669907 None] Create snapshot completed successfully Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-f34b1ad4-8f11-40a6-8237-3010bb430478-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Lock "cinder-f34b1ad4-8f11-40a6-8237-3010bb430478-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-14e33dde-6862-471d-b8e6-4ccc2e643b1b" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-14e33dde-6862-471d-b8e6-4ccc2e643b1b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-f34b1ad4-8f11-40a6-8237-3010bb430478" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-f34b1ad4-8f11-40a6-8237-3010bb430478" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Deleting offline snapshot f34b1ad4-8f11-40a6-8237-3010bb430478 of volume 14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] snapshot_file for this snap is: volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db4ab04-384e-452c-a52a-75eba38aa01b]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:41 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 Sep 29 12:15:41 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:41 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478" returned: 0 in 0.359s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8fd4c5-f034-4760-b520-f6dd18e84734]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:41 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:41 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b Sep 29 12:15:41 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:42 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b" returned: 0 in 0.369s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:42 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 Sep 29 12:15:42 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:42 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478" returned: 0 in 0.340s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:42 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478 Sep 29 12:15:42 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:42 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b.f34b1ad4-8f11-40a6-8237-3010bb430478" returned: 0 in 0.233s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-f34b1ad4-8f11-40a6-8237-3010bb430478" released by "_delete_snapshot" :: held 1.398s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-14e33dde-6862-471d-b8e6-4ccc2e643b1b" released by "delete_snapshot" :: held 1.419s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:INSERT=39,cinder:UPDATE=147,cinder:SELECT=119,cinder:DELETE=13 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=106,cinder:INSERT=41,cinder:UPDATE=142,cinder:DELETE=11 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Created reservations ['aac31c95-c633-4e1d-908d-bab432d1b86f', 'afef9493-d845-4fc4-b099-cda0c8ee515f', '7f72ea20-dcbb-4289-b789-7ca6772e6d43', '6ff4c5d1-0919-48a4-95bc-ae7956ed5ccc'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:42 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Delete snapshot completed successfully. Sep 29 12:15:42 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-c916c551-777a-490c-854d-ae8884e9ca9d tempest-ProjectReaderTests-434669907 None] Lock "cinder-f34b1ad4-8f11-40a6-8237-3010bb430478-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-14e33dde-6862-471d-b8e6-4ccc2e643b1b-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Lock "cinder-14e33dde-6862-471d-b8e6-4ccc2e643b1b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-14e33dde-6862-471d-b8e6-4ccc2e643b1b" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:43 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-14e33dde-6862-471d-b8e6-4ccc2e643b1b" acquired by "delete_volume" :: waited 0.019s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:43 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca110f10-fb59-4c0f-83dc-10db0a52abf8]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:43 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:43 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b Sep 29 12:15:43 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:44 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:44 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b Sep 29 12:15:44 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:44 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-14e33dde-6862-471d-b8e6-4ccc2e643b1b" returned: 0 in 0.235s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-14e33dde-6862-471d-b8e6-4ccc2e643b1b" released by "delete_volume" :: held 0.647s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Created reservations ['4fec4ab0-955b-4058-84e2-cc3f7df86064', '18da3121-fa29-47de-b3f4-bd3d07a5fb5f', '75ccbba4-7f84-4cda-9034-d1c77bd0b3d2', '40e71fbf-be35-4c97-853a-a0bbb1640f61'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:44 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:44 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:44 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:44 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Deleted volume successfully. Sep 29 12:15:44 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9b1519d6-8aeb-49ab-a85e-5255ddfa3298 tempest-ProjectReaderTests-434669907 None] Lock "cinder-14e33dde-6862-471d-b8e6-4ccc2e643b1b-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (2410353d-acc6-4523-afc1-3b1e335e0e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be8a896-1c97-42fa-b6fc-b7d872967fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be8a896-1c97-42fa-b6fc-b7d872967fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339966058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466c1641-3284-4f12-8b69-aa2162b8175d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:45Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275864f6-c3a7-4e3c-a7b9-5920b135c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275864f6-c3a7-4e3c-a7b9-5920b135c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9006192f-8c00-47f0-99c3-2ada8c5384fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9006192f-8c00-47f0-99c3-2ada8c5384fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466c1641-3284-4f12-8b69-aa2162b8175d', 'volume_name': 'volume-466c1641-3284-4f12-8b69-aa2162b8175d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a02fd2-877b-474a-8efd-271fd418179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a02fd2-877b-474a-8efd-271fd418179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a349c7ec-eb7f-49a6-a430-d259f0637cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:45 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Volume 466c1641-3284-4f12-8b69-aa2162b8175d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466c1641-3284-4f12-8b69-aa2162b8175d', 'volume_size': 1} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T10:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339966058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466c1641-3284-4f12-8b69-aa2162b8175d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbd34bfadb47c5861108b9c4a5e9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:15:45Z,use_quota=True,user_id='94c1d66cf83e4857a7be66585a71295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b22596f8-0ce8-4897-8c40-3cc8efffe6ff),volume_type_id=b22596f8-0ce8-4897-8c40-3cc8efffe6ff)}" {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Creating volume 466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Selected osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d as target Quobyte volume. {{(pid=86117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 12:15:45 devstack cinder-volume[86117]: INFO cinder.volume.drivers.remotefs [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] casted to osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d 1073741824 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:45 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d 1073741824 Sep 29 12:15:45 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:45 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d 1073741824" returned: 0 in 0.384s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:45 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d Sep 29 12:15:45 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:45 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] <== create_volume: return (656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'} {{(pid=86117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a349c7ec-eb7f-49a6-a430-d259f0637cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466c1641-3284-4f12-8b69-aa2162b8175d', 'volume_size': 1}' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b767df1-30f9-4950-9519-e7a58f69c16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 12:15:45 devstack cinder-volume[86117]: INFO cinder.volume.flows.manager.create_volume [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Volume volume-466c1641-3284-4f12-8b69-aa2162b8175d (466c1641-3284-4f12-8b69-aa2162b8175d): created successfully Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b767df1-30f9-4950-9519-e7a58f69c16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86117) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 12:15:45 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Flow 'volume_create_manager' (2410353d-acc6-4523-afc1-3b1e335e0e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86117) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 12:15:45 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-aabe767b-be56-4974-bcff-60b90e088d9c tempest-ProjectReaderTests-434669907 None] Created volume successfully. Sep 29 12:15:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:46 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Creating offline snapshot bc20708f-dbe7-459c-ba39-a8e3d33b04a7 of volume 466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 12:15:46 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddde380-99d6-4f2b-bd05-dda1b5045545]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:46 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d Sep 29 12:15:46 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:46 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d" returned: 0 in 0.345s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:46 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 1G {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:46 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 1G Sep 29 12:15:46 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:47 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 1G" returned: 0 in 0.362s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466c1641-3284-4f12-8b69-aa2162b8175d -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:47 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466c1641-3284-4f12-8b69-aa2162b8175d -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 Sep 29 12:15:47 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:47 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466c1641-3284-4f12-8b69-aa2162b8175d -F qcow2 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7" returned: 0 in 0.265s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:47 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 is being set with open permissions: ugo+rw Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:47 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 Sep 29 12:15:47 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:47 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7" returned: 0 in 0.233s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:47 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.info Sep 29 12:15:47 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:47 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.info" returned: 0 in 0.234s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:47 devstack cinder-volume[86117]: WARNING cinder.volume.drivers.remotefs [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.info is being set with open permissions: ugo+rw Sep 29 12:15:47 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.info {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:47 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.info Sep 29 12:15:47 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:48 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.info" returned: 0 in 0.241s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.758s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:48 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-a939a61f-2c50-4ed8-9c17-496a4b6cce6a tempest-ProjectReaderTests-434669907 None] Create snapshot completed successfully Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-bc20708f-dbe7-459c-ba39-a8e3d33b04a7-delete_snapshot" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Lock "cinder-bc20708f-dbe7-459c-ba39-a8e3d33b04a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-466c1641-3284-4f12-8b69-aa2162b8175d" by "delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-466c1641-3284-4f12-8b69-aa2162b8175d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-bc20708f-dbe7-459c-ba39-a8e3d33b04a7" by "_delete_snapshot" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-bc20708f-dbe7-459c-ba39-a8e3d33b04a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Deleting offline snapshot bc20708f-dbe7-459c-ba39-a8e3d33b04a7 of volume 466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] snapshot_file for this snap is: volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 {{(pid=86117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[551cb27f-ed1e-45a7-938a-b9f2594e589d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:48 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 Sep 29 12:15:48 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:48 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7" returned: 0 in 0.351s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.remotefs [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-466c1641-3284-4f12-8b69-aa2162b8175d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac3c98-84d5-4dbb-a2e0-16dc23f7100d]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:48 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:48 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d Sep 29 12:15:48 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:49 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d" returned: 0 in 0.339s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:49 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 Sep 29 12:15:49 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:49 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7" returned: 0 in 0.328s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:49 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7 Sep 29 12:15:49 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:49 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d.bc20708f-dbe7-459c-ba39-a8e3d33b04a7" returned: 0 in 0.230s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-bc20708f-dbe7-459c-ba39-a8e3d33b04a7" released by "_delete_snapshot" :: held 1.341s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-466c1641-3284-4f12-8b69-aa2162b8175d" released by "delete_snapshot" :: held 1.361s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Created reservations ['c8003550-bff8-457d-b233-21cc38bc223d', '2e06cd6e-49ea-4bd0-9859-eef65f6edcbe', '45104857-417c-4c9c-82ef-555baff87e2b', '9d25afd1-9c03-4f86-83ea-bd4d744cd07c'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:49 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Delete snapshot completed successfully. Sep 29 12:15:49 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-9aa3fb17-af44-47b7-a3d1-a615e49e72de tempest-ProjectReaderTests-434669907 None] Lock "cinder-bc20708f-dbe7-459c-ba39-a8e3d33b04a7-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-466c1641-3284-4f12-8b69-aa2162b8175d-delete_volume" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Lock "cinder-466c1641-3284-4f12-8b69-aa2162b8175d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Acquiring lock "cinder-quobyte-466c1641-3284-4f12-8b69-aa2162b8175d" by "delete_volume" {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-466c1641-3284-4f12-8b69-aa2162b8175d" acquired by "delete_volume" :: waited 0.014s {{(pid=86117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc2db3b-fa05-4d73-b740-27c6f96aa1f7]: (4, 'qcow2') {{(pid=87886) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:50 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d Sep 29 12:15:50 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:50 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d" returned: 0 in 0.354s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:50 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:51 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d Sep 29 12:15:51 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:51 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80/volume-466c1641-3284-4f12-8b69-aa2162b8175d" returned: 0 in 0.235s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Lock "cinder-quobyte-466c1641-3284-4f12-8b69-aa2162b8175d" released by "delete_volume" :: held 0.642s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG cinder.quota [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Created reservations ['64d2f00c-29e3-40d1-bc59-7648348df465', '557ad6b6-e097-4046-81ee-3e8625412822', '76429f27-542a-4c8d-929e-d296a9d5b576', '6e646169-6532-4ef4-86dc-f476f3aa1c05'] {{(pid=86117) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:15:51 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:15:51 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:15:51 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.232s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:15:51 devstack cinder-volume[86117]: INFO cinder.volume.manager [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Deleted volume successfully. Sep 29 12:15:51 devstack cinder-volume[86117]: DEBUG cinder.coordination [None req-626dc01d-886d-4782-8954-45f4d4e895ad tempest-ProjectReaderTests-434669907 None] Lock "cinder-466c1641-3284-4f12-8b69-aa2162b8175d-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86117) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 12:16:01 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:INSERT=9,cinder:UPDATE=24,cinder:SELECT=23,cinder:DELETE=1 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:16:01 devstack cinder-volume[86117]: DEBUG dbcounter [-] [86117] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=86117) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d': None} {{(pid=86117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG cinder.volume.drivers.quobyte [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea98aa9d-0320-4d89-8b53-3e8704f1f42d'] {{(pid=86117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.lockutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86117) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 12:16:12 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80 Sep 29 12:16:12 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 12:16:12 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG oslo_concurrency.processutils [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2ad5b36cf096cd3eefc2f0166de5a80" returned: 0 in 0.230s {{(pid=86117) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG cinder.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Notifying Schedulers of capabilities ... {{(pid=86117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG oslo_service.periodic_task [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] Running periodic task VolumeManager._thread_info {{(pid=86117) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread count: 28 {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 12:16:12 devstack cinder-volume[86117]: DEBUG cinder.volume.manager [None req-7bb98647-92a9-4b72-8e8c-f6c5db50ca0c None None] thread info: [<_MainThread(MainThread, started 125369965572224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86117) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}